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(54) [Name of Invention] Methods for measuring the three- 
dimensional form of an object 

(57) [Abstract] 

[Problem(s)] It is not possible to accurately measure the 
three-dimensional form of an object due to shape changes 
and irregularities in object surfaces, surface variations, 
patterns, dirt, the size of the object, or the compositional 
material. As a result, a long time is required for processing. 
[Means to Solve Problem(s)] A method applicable to three- 
dimensional form measurement devices equipped with a 
color camera for taking pictures of objects 103, an A/D 
converter 105, frame memory 106, a projector 104 for 
projecting pattern light with arbitrary color and intensity 
onto an object 102, pattern memory 107 that stores the 
projected pattern data, memory 108, a D/A converter 110, 
display 111 and CPU 109. Create pattern data by 
composing multiple sinusoid slit pattern data that has 
different frequency elements and color elements. The 
transformed lattice images obtained by projecting pattern 
light based on this data onto an object 102 are separated by 
color elements, and then by calculating the form of the 
object 102 from the per-color element transformed lattice 
images, a final three-dimensional form is assumed from the 
compositing of the calculation results. 
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[Scope of Claims] 

[Claim 1] Methods for measuring the three-dimensional 
form of an object characterized by: creating pattern data by 
composing multiple sinusoid slit pattern data that has 
different frequency elements and color elements with a 
three-dimensional form measurement device for objects 
equipped with a color camera for taking pictures of the 
surface form of objects, an A/D converter that converts 
analog image data output from this camera into digital 
image data, frame memory that stores the digital image data 
output from the A/D converter, a projector for projecting 
pattern light onto an object that has arbitrary color and 
intensity by being configured in different directions from 
the color camera, pattern memory that stores the pattern 
data of the pattern light projected by the projector, memory 
as a work area, a D/A converter that converts digital image 
data into analog image data, a display that shows analog 
image data output from the D/A converter and a CPU ; that 
controls everything and performs calculations; separates the 
transformed lattice images obtained by projecting pattern 
light based on this pattern data onto an object by color 
elements and then calculates the form of the object from the 
per-color element transformed lattice image; and assumes a 
final three-dimensional form for the object from the 
compositing of these calculation results. 
[Claim 2] Methods for measuring the three-dimensional 
form of objects characterized by: creating pattern data by 
composing multiple sinusoid slit pattern data that has the 
same frequency elements with different color elements by 
off- setting the phase per fixed amounts with a three- 
dimensional form measurement device for objects equipped 
with a color camera for taking pictures of the surface form 
of objects, an A/D . converter that converts analog image 
data output from this camera into digital image data, frame 
memory that stores the digital image data output from the 
A/D converter, a projector for projecting pattern light onto 
an object that has arbitrary color and intensity by being 
configured in different directions from the color camera, 
pattern memory that stores the pattern data of the pattern 
light projected by the projector, memory as a work area, a 
D/A converter that converts digital image data into analog 
image data, a display that shows analog image data output 
from the D/A converter and a CPU that controls everything 
and performs calculations; separates the transformed lattice 
images obtained by projecting pattern light based on this 
pattern data onto an object per color elements and then 
calculates the three-dimensional form of an object by 
calculating the amount of phase modulation from between 
the per-color element transformed lattice images. 
[Claim 3] Methods for measuring the three-dimensional 
forms of objects, using the three-dimensional form 
measurement methods in Claim 1 or Claim 2, characterized 
by: radially configuring multiple color cameras against an 
object to take pictures of the object from multiple 
directions and then calculating the three-dimensional form 
of the object by composing form data measured based on 
images observed by each camera. 

[Claim 4] Methods for measuring the three-dimensional 
form of objects, using the three-dimensional form 
measurement methods in Claim 1 or Claim 2, characterized 
by: juxtaposing multiple color cameras against an object so 
that they divide the flat measurement range of an object, 



and then calculating the three-dimensional form of an 
object by composing form data measured based on images 
observed by each camera. 

[Claim 5] Methods for measuring the three-dimensional 
forms of objects, using the three-dimensional form 
measurement methods in Claim 1 or Claim 2, characterized 
by: radially configuring multiple projectors against an 
object to project pattern light from multiple directions onto 
the object, and then calculating the three-dimensional form 
of the object from form data measured based on images 
observed by camera via pattern light from each projector. 
[Claim 6] Methods for measuring the three-dimensional 
form of objects, using the three-dimensional form 
measurement methods in Claims 1 , 2, 3 or 4, characterized 
by: juxtaposing multiple projectors against an object so that 
they divide the flat projection range of the pattern light 
against the object, and then calculating the three- 
dimensional form of the object from form data measured 
based on images observed by camera via pattern light from 
each projector. 

[Claim 7] Methods for measuring the three-dimensional 
form of objects, using the three-dimensional form 
measurement methods in Claim 5 or Claim 6, 
characterized by: detecting shadow sections generated by 
surface variations between the reference plane in which the 
object is placed and the object itself by projecting white 
and solid-color pattern light onto the object from multiple 
projectors, and then detecting the contour positions and 
height of the object by the shadow sections, based on the 
projection angle of the pattern light, and then calculating 
the form of the object by projecting pattern light based on 
slit pattern data, with only the areas determined to be where 
the object exists based on the contour position information 
as the subject, and then correct the calculated form to an 
absolute value based on the aforementioned contour 
position and height. 

[Claim 8] Methods for measuring the three-dimensional 
form of objects, using the three-dimensional form 
measurement methods in Claim 5 or Claim 6, characterized 
by: detecting shadow sections generated by surface 
variations in the top of an object surface by projecting 
white and solid-color pattern light onto the object from 
multiple projectors, and then together with detecting the 
edge positions of the surface variations from this shadow 
information, detecting the height at the edge positions of 
the surface variations from the projection angle of the 
pattern light, and then detecting the highs and lows on both 
sides of the edge positions from the projecting direction of 
the pattern light that generates the shadow sections, and 
then correcting the calculation results for the three- 
dimensional form of the object using these detection values. 
[Claim 9] Methods for measuring the three-dimensional 
form of objects, using the three-dimensional form 
measurement method in Claim 8, characterized by making 
multiple divisions of the planer shape of the object per 
areas that have the same height, based on the surface 
variations in the edge positions on the object surface and 
the contour positions of the object, detecting the forms per 
area by adjusting the frequency elements of the pattern 
light per divided area, and then calculating an overall three- 
dimensional image of the object by composing these forms. 
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[Claim 10] Methods for measuring the three-dimensional 
form of objects, using the three-dimensional form 
measurement method in Claim 9, characterized by: using 
lenses that can electrically adjust the focus of camera and 
projector lenses, and, when performing form calculations 
per areas of the object divided by the areas that have the 
same height, adjusting the focus of the aforementioned 
lenses via an interface from a CPU, according to the 
average height of these areas. 

[Claim 1 1] Methods for measuring the three-dimensional 
form of objects, using one item from Claims 5-10, 
characterized by: calculating the luminance difference of 
each pixel for images taken by camera of conditions in 
which pattern light is not projected from all projectors, and 
images taken by camera of conditions in which pattern light 
is projected by all projectors, determining if the form is 
irregular for areas in which this luminance difference is 
minute, and then measuring the three-dimensional form of 
objects from measurement data from areas other than these 
areas. 

[Claim 12] Methods for measuring the three-dimensional 
form of objects, with three-dimensional form measurement 
methods in Claim 1, characterized by: using lenses that can 
electrically adjust the aperture of camera and projector 
lenses, adjusting the aperture of the lens via an interface 
from a CPU in order to increase the luminance for areas for 
which it is determined that the luminance difference is 
minute and the form is irregular due to the previous form 
measurement, recalculating the luminance difference under 
conditions in which the aperture has been adjusted, then 
dividing it into areas for which the luminance difference 
has changed and areas for which it has not changed due to 
aperture adjustments for areas for which it was determined 
that the form was irregular due to the previous form 
measurements, re-measuring the form by projecting pattern 
light at areas in which the luminance difference had 
changed, determining form irregularities in areas where the 
luminance difference had not changed, and then measuring 
the three-dimensional form of the object by compositing 
the previous form measurement results and the 
measurement results for the new re-measurements, 
[Claim 13] Methods for measuring the three-dimensional 
form of objects, using one item from Claims 5-10, 
characterized by: extracting the areas where the luminance 
is saturated due to surface conditions of the object from 
images taken by camera of conditions in which pattern light 
is projected from all the projectors, determining if the form 
is irregular in these areas, and then measuring the three- 
dimensional form of the object from the measurement data 
for areas other than these areas, 

[Claim 14] Methods for measuring the three-dimensional 
form of objects, with three-dimensional form measurement 
methods in Claim 13, characterized by: using lenses that 
can electrically adjust the aperture of camera and projector 
lenses, adjusting the aperture of the lens via an interface 
from a CPU in order to reduce luminance for areas for 
which the luminance is saturated and it is determined that 
the form is irregular due to the previous form measurement, 
re-extracting the luminance saturation area under 
conditions in which the aperture has been adjusted, then 
dividing it into areas for which the luminance has changed 
and areas for which it has re-saturated due to aperture 



adjustments for areas for which it was determined that the 
form was irregular due to the previous form measurements, 
re-measuring the form by projecting pattern light at areas in 
which the luminance has changed, determining form 
irregularities in areas where the luminance has re-saturated, 
and then measuring the three-dimensional form of objects 
by compositing the previous form measurement results and 
the measurement results for the new re-measurements. 
[Detailed Explanation of Invention] 
[0001] 

[Field of Technology] This invention takes pictures of 
transformed lattice images obtained by projecting pattern 
light from a projector with a color camera, and is related to 
methods for measuring the three-dimensional form of 
objects by making contactless measurements of the three- 
dimensional form of objects. 
[0002] 

[Prior Art] The standard method of measuring the form of 
an object by projecting pattern light onto it is the known 
method for contactless measurement of the three- 
dimensional forms of objects.* The principle of this method 
is to project standard pattern light, such as coherent light 
from a grill slit light or laser light, for example, against an 
object. For these standard patterns, interference fringes 
from a laser light are used for small objects, while arbitrary 
patterns generated by projecting lattice patterns made on 
film by a light source such as a slide projector, or using a 
liquid crystal device instead of film, are used for large 
objects. 

[0003] When objects that have standard patterns projected 
on them are observed by camera from a direction other than 
the direction from which the standard pattern was projected, 
transformed lattice images for which the pattern light 
changed due to the form of the object are observed. By 
analyzing this altered state of the lattice image, it is 
possible to obtain the original three-dimensional shape of 
the object. 

[0004] Various methods are available for analyzing 
transformed lattice images. For example, as a first method, 
there is the stripe scanning or phase shift method of 
calculating the original form of an object by shifting the 
phase of projected patterns, and then calculating the phases 
of each pixel from among the transformed lattice images 
made by these shifted patterns (Komatsubara, Yoshizawa: 
"Lattice Pattern Projection with Introduction of Stripe 
Scanning," Precision Society Review, Vol. 55, No. 10, pp. 
1817-1822(1989)). 

[0005] As a second method, there is the Fourier transform 
method for calculating the form of an object by 
transforming the transformed lattice images made by one of 
the projected patterns into frequency domains, and then 
extracting only the required frequency elements (M. 
Takeda, K. Mutoh: "Fourier transform profilometry for the 
automatic measurement of 3-D object shapes", applied 
Optics, Vol. 22, No. 24, pp. 3977-3982 (1983)). 
[0006] As a third method, there is the scanning moire 
method for calculating the form of an object from moire 
images obtained with transformed lattice images observed 
by projecting patterns that match camera scanning lines, 
and using the camera scanning lines as a reference grid on 
the observation side. (Arai, Kurata: "High-speed and high- 
resolution moire" topography through techniques for stripe 



I) ti 

(4) 



Laid-Open Patent H9-21620 



scanning interferometry," Optical, Vol. 15, No. 5, pp. 
402-406(1986)). 

[0007] Furthermore, as a fourth method, there is the phase- 
shift electron moire method for calculating the form of an 
object by making moire images by computer between the 
transformed lattice images made by one of the projected 
patterns and the reference patterns offset by two or more 
phases created in the computer, and then calculating the 
form from the phases between these moire images. (Katoh, 
Yamaguchi: "Real-time processing of striped images using 
phase-shift electron moir6," Sensor Technology, Vol. 12, 
No. 7, pp. 39-44 (1992)). 

[0008] Irregardless of the method, intensity distribution I (x, 
y) of the stripes obtained for each observed pixel are 
defined the by Formula 1, and the phase information q> (x, y) 
is calculated for each point. 
[0009] 

[Formula 1] I (x, y) = A (x, y) + B (x, y) • cos (27rfx + 0 (x, 

y)) 

[0010] Here, 0 is information that is reflecting the form of 
an object, and if it is possible to obtain this <£, then it is 
possible to calculate the form. The phase information <f> for 
each point is folded into the range of -7i<<£<7r (assumed to 
be -7r/2<<£<7r/2 according to method), and a discontinuous 
value is taken. This is connected by methods such as the 
so-called phase unwrapping method (refer to K. Itoh: 
Analysis of the phase unwrapping algorithm," Applied 
Optics, Vol. 21, No. 14, pp. 2470 (1982) and continuous 
phase distribution is obtained. Therefore, the phases are 
transformed into the three-dimensional form of an object in 
space, based upon the optical position of the camera or 
light source, as the final form. 

[0011] These methods are applicable primarily to objects 
which do not have drastic changes in the form of their 
surfaces. 
[0012] 

[Problems to be Solved by Invention] As described above, 
the following problems exist for conventional techniques 
for measuring the three-dimensional form of objects by 
projecting pattern light. 

(1) Because it is not possible to measure drastic changes in 
object surfaces by a single pattern projection, multiple 
projections and observations of different patterns becomes 
necessary. Since it is only possible to perform 
measurements in situations in which the object is stationary, 
a great deal of time is consumed to complete all processes 
and calculations. 

[0013] (2) If the forrn changes of an object's surface are 
drastic, then it is not possible to make camera observations 
since the pattern light projected onto the object is blocked 
by the object itself. In addition, by the pattern light from 
the projector being blocked by the object, then areas are 
created in which the object is not touched by the pattern 
light. 

(3) If the subject object is larger than the camera's field of 
view or the projection area of the projector, it is not 
possible to make measurements of the form with a single 
pattern projection, making it necessary to move the object 
or optical system. In this case, it is easy for differences to 
arise in the measurement results for the object form at each 
position to which the object is moved. 



[0014] (4) In cases where an object is measured while 
placed on a standard flat surface, if pattern light greater 
than a single cycle is blocked by surface variations between 
the standard surface and object, then the calculated form of 
the object will be a relative value. 

(5) In cases where the irregularities that exist in an object 
surface represent stepped surface variations, or are some 
such similarly irregular form, then if the form is calculated 
without taking into account these heights, then it will not be 
possible to accurately measure the form of the object. 
[0015] (6) In the high sections of the object that has 
variations on its surface, the pitch against the object surface 
of the projected pattern light is complicated, and then 
precision deteriorates for low sections when the pitch 
matches these high sections. 

(7) In cases where the surface variations are extremely high 
for surface variations between an object and the standard 
surface, as well as the object surface, the focus of the image 
taken by the camera and the projected pattern light is 
shaded off, and then it is not possible to accurately measure 
the form. 

[0016] (8) If changes in the projected pattern light due to 
patterns, dirt, or small holes in an object surface are not 
detected, and the form of the overall object is calculated 
including the observational data for such areas, it is not 
possible to obtain an accurate form. 
(9) In cases where projected pattern light is reflected by an 
object's material or surface form in which such changes are 
not detected, if the form of the overall object js calculated 
including the observational data for such areas, it is not 
possible to obtain an accurate form. 
[0017] This invention is meant to solve the various 
problems mentioned above, and to that purpose, provides 
three-dimensional form measurement methods for which it 
is possible to accurately and speedily measure the three- 
dimensional form of an object irregardless of changes, 
irregardless of factors such as form changes, irregularities, 
or variations in the object surface, patterns, dirt, the 
object's size, or the object material. 
[0018] 

[Means for Solving Problems] An invention as in Claim 1 
for solving the aforementioned Problem (1) that creates 
pattern data by composing multiple sinusoid slit pattern 
data that has different frequency elements and color 
elements, calculates the form of the object from the per- 
color element transformed lattice images, together with 
separating the transformed lattice images obtained by 
projecting pattern light based on this pattern data onto the 
object by color elements, and assumes a final - three- 
dimensional form for the object from the compositing of 
these calculation results; using a three-dimensional form 
measurement device for objects equipped with a color 
camera for taking pictures of the surface form of objects, an 
A/D converter that converts analog image data output from 
this camera into digital image data, frame memory that 
stores the digital image data output from the A/D converter, 
a projector for projecting pattern light onto the object that 
has arbitrary color and intensity by being configured in 
directions different from the color camera, pattern memory 
that stores the pattern data of the pattern light projected by 
the projector, memory as a work area, a D/A converter that 
converts digital image data into analog image data, a 
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display that shows analog image data output from the D/A 
converter, and a CPU that controls everything and performs 
calculations. 

[0019] An invention as in Claim 2 for solving the 
aforementioned Problem (1) that creates pattern data by 
composing multiple sinusoid slit pattern data that has the 
same frequency elements with different color elements by 
off-setting the phase per fixed amounts, separates the 
transformed lattice image obtained by projecting pattern 
light based on this pattern data onto an object by color 
elements, and then calculates the three-dimensional form of 
objects by calculating the phase modulation from between 
the per color transformed lattice images, with a three- 
dimensional form measurement device for objects equipped 
with a color camera for taking pictures of the surface form 
of objects, an A/D converter that converts analog image 
data output from this camera into digital image data, frame 
memory that stores the digital image data output from the 
A/D converter, a projector for projecting pattern light onto 
the object that has arbitrary color and intensity by being 
configured in directions different from the color camera, a 
pattern memory that stores the pattern data of the pattern 
light projected by the projector, a memory as a work area, a 
D/A converter that converts digital image data into analog 
image data, a display that shows analog image data output 
from the D/A converter, and a CPU that controls everything 
and performs calculations. 

[0020] An invention as in Claim 3 for solving the 
aforementioned Problem (2) that, using Claim 1 or 2, 
radially configures multiple color cameras against an object 
to take pictures of the object from multiple directions, and 
then calculates the three-dimensional form of the object by 
compositing the form data measured based upon the image 
observed by each camera. 

[0021] An invention as in Claim 4 for solving the 
aforementioned Problem (3) that, using Claim 1 or 2, 
juxtaposes multiple color cameras against an object so that 
they divide the flat measurement range of the object, and 
then calculates the three-dimensional form of the object by 
compositing the form data measured based upon the image 
observed by each camera. 

[0022] An invention as in Claim 5 for solving the 
aforementioned Problem (2) that, using Claim 1, 2 or 3, 
radially configures multiple projectors against an object to 
project pattern light from multiple directions onto the 
object, and then calculates the three-dimensional form of 
the object from form data measured based on images 
observed by camera via pattern light from each projector. 
[0023] An invention as in Claim 6 for solving the 
aforementioned Problem (3) that, using Claim 1 , 2, 3 or 4, 
juxtaposes multiple projectors against an object so that they 
divide the flat projection range of the pattern light against 
the object, and then calculates the three-dimensional form 
of the object from form data measured based on images 
observed by camera via pattern light from each projector. 
[0024] An invention as in Claim 7 for solving the 
aforementioned Problem (4) that, using Claim 5 or 6, 
detects shadow sections generated by surface variations 
between the reference plane in which the object is placed 
and the object itself by projecting white and solid-color 
pattern light onto an object from multiple projectors, 
detects the contour positions and height of the object by the 



shadow sections, based on the projection angle of the 
pattern light, and then calculates the form of the object by 
projecting pattern light based on slit pattern data, and 
corrects the calculated form to an absolute value based on 
the aforementioned contour position and height. 
[0025] An invention as in Claim 8 for solving the 
aforementioned Problem (5) that, using Claim 5 or 6, 
detects shadow sections generated by variations on the top 
of the object surface by projecting white and solid-color 
pattern light onto the object from multiple projectors, 
detects the edge positions of surface variations from this 
shadow information, and detects the height at the edge 
positions of the surface variations from the projection angle 
of the pattern light, and then detects the highs and lows on 
both sides of the edge positions from the projecting 
direction of the pattern light that generates the shadow 
sections, and then corrects the calculation results for the 
three-dimensional form of the object using these detection 
values. 

[0026] An invention as in Claim 9 for solving the 
aforementioned Problem (6) that, using Claim 8, makes 
multiple divisions of the planer shape of the object per 
areas that have the same height, based on the surface 
variations in the edge positions on the object surface and 
the contour positions of the object, detects the forms per 
area by adjusting the frequency elements of the pattern 
light per divided area, and then calculates an overall three- 
dimensional image of the object by composing these forms. 
[0027] An invention as in Claim 10 for solving the 
aforementioned Problem (7) that, using Claim 9, uses 
lenses that can electrically adjust the focus of camera and 
projector lenses, and, when performing form calculations 
per areas of the object divided by the areas that have the 
same height, adjusts the focus of the aforementioned lenses 
via an interface from a CPU, according to the average 
height of these areas. 

[0028] An invention as in Claim 11 for solving the 
aforementioned Problem (8) that, using one item from 
Claims 5-10, calculates the luminance difference of each 
pixel for images taken by camera of conditions in which 
pattern light is not projected from all projectors, and images 
taken by camera of conditions in which pattern light is 
projected by all projectors, determines if the form is 
irregular for areas in which this luminance difference is 
minute, and then measures the three-dimensional form of 
objects from measurement data from areas other than these 
areas. 

[0029] An invention as in Claim 12 for solving the 
aforementioned Problem (8) that, using Claim 1 1 / uses 
lenses that can electrically adjust the aperture of camera 
and projector lenses, adjusts the aperture of the lens via an 
interface from a CPU in order to increase the luminance for 
areas for which it is determined that the luminance 
difference is minute and the form is irregular from the 
previous form measurement, calculates the luminance 
difference under conditions in which the aperture has been 
adjusted, then divides it into areas for which the luminance 
difference has changed and areas for which it has not 
changed due to aperture adjustments for areas for which it 
was determined that the form was irregular due to the 
previous form measurements, re-measures the form by 
projecting pattern light at areas where luminance difference 
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has changed, determines form irregularity for areas where 
the luminance difference has not changed, and then 
measures the three-dimensional form of objects by 
compositing the previous form measurement results and the 
measurement results for the new re-measurements. 
[0030] An invention as in Claim 13 for solving the 
aforementioned problem (9) that, using one item from 
Claims 5-10, extracts the areas where the luminance is 
saturated due to surface conditions of the object from 
images taken by camera of conditions in which pattern light 
is projected from all the projectors, determines if the form 
is irregular in these areas, and then measures the three- 
dimensional form of the objects from the measurement data 
for areas other than these areas. 

[0031] An invention as in Claim 14 for solving the 
aforementioned Problem (9) that, using Claim 13, uses 
lenses that can electrically adjust the aperture of camera 
and projector lenses, adjusts the aperture of the lenses via 
an interface from a CPU in order to reduce the luminance 
for areas for which the luminance is saturated and it is 
determined that the form is irregular due to the previous 
form measurement, re-extracts the luminance saturation 
area under conditions in * which the aperture has been 
adjusted, then divides it into areas for which the luminance 
has changed and areas for which it has re-saturated due to 
aperture adjustments for areas for which it was determined 
that the form was irregular due to the previous form 
measurements, re-measures the form by projecting pattern 
light at areas in which the luminance has changed, 
determines form irregularities for areas where the 
luminance has re-saturated, and then measures the three- 
dimensional form of objects by compositing the previous 
form measurement results and then the measurement results 
for the new re-measurements. 
[0032] 

[Operation] Using an invention as in Claim 1, pattern light 
that is to be projected onto an object is projected from a 
projector onto an object as a color image written into 
pattern memory that is the same as display graphics. At 
that time, pattern light based on pattern data that 
synthesizes high and low slit patterns for frequency 
elements is used as the pattern light to be projected onto an 
object. Then, pattern data is written into pattern memory so 
that particular color elements are expressed, and when this 
pattern light is projected onto an object, transformed lattice 
images that correspond to the form of the object can be 
observed by camera. 

[0033] When observed transformed lattice images are 
separated by synthesized color elements, it is possible 
simultaneously to obtain transformed lattice images 
obtained in cases where pattern light for many different 
frequency elements was projected from one color image. It 
is necessary for high-frequency element patterns to be used 
for measuring forms with high precision, and, in addition, it 
is also necessary for low-frequency element patterns to be 
used in cases where the changes in the form are great. 
[0034] With this invention, transformed lattice images are 
taken from single observations that accompany projection 
of the pattern light obtained by composing the 
aforementioned patterns, and then the forms of objects are 
measured per color elements. Furthermore, as for the 
specific method for calculating the form, either the Fourier 



transform method or the stripe scanning moire methods are 
acceptable. In sections where the form of the object 
changes drastically (in size), gaps in information are 
produced by high-frequency element patterns, and there are 
cases where it is not possible to accurately calculate the 
form. To that end, first calculate the macro-form from the 
low-frequency element patterns, and then next measure the 
three-dimensional form with accuracy and high precision 
by correcting the gap sections of the macro-form 
information by using high-frequency element patterns. 
[0035] With inventions as in Claim 2, these pattern data are 
synthesized as different color elements, together with 
having the same specific frequency elements and creating 
slit pattern data for which the phase has been shifted by irD 
2, 7rand 37rD2, for example, as synthetic slit patterns to be 
projected onto an object. Transformed lattice images are 
taken by projecting this synthesized pattern light onto an 
object, and then separating it into transformed lattice 
images per phase through color separation from one 
transformed lattice images. The three dimensional form of 
the object is then calculated by obtaining the amount of 
phase modulation for each pixel from among these images. 
[0036] With inventions as in Claim 3, the dead angle 
produced when observing an object with a camera from 
certain specific directions is eliminated by observing an 
object from multiple directions with multiple cameras. 
Specifically, by composing and interpolating the form data 
for the observed object from multiple cameras, it becomes 
possible to make partial measurements of the three- 
dimensional form of an object that cannot be analyzed by 
observations along a single direction. 
[0037] With inventions as in Claim 4, in cases where the 
measurement range is wide and the planer shape of an 
object is large, the picture-taking range is divided by 
multiple cameras. If form data is synthesized by 
simultaneously observing the form with multiple cameras, 
then it is not necessary to move the object or the camera, 
and it is possible to measure the overall form of an object 
with a single picture taking. 

[0038] With inventions as in Claim 5, multiple projectors 
configured radially project pattern light onto an object from 
mutually opposing directions. In cases where the camera is 
placed directly above an object and the multiple projectors 
are each placed diagonally upwards, pattern light will strike 
the areas on the projection side where the object has 
irregular sections, but on the opposite side, the light is 
blocked by the irregular sections of the object and pattern 
light does not reach. With this type of measurement 
method, in which the form is measured by projecting 
pattern light, it is not possible to calculate the form for 
those sections that pattern light does not reach. 
Accordingly, by projecting pattern light onto an object 
from different directions using multiple projectors, it is 
possible to hit all areas of an object's surface with pattern 
light, and therefore it is possible to measure the entire form 
of an object without omissions. 

[0039] With inventions as in Claim 6, in cases where the 
planer shape of an object is large and the measurement 
range is wide, the projection area of the pattern light is 
divided by multiple projectors. Simultaneously projecting 
light by multiple projectors, the three-dimensional form of 
an object is measured from observational data from a single 
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or multiple cameras. Furthermore, in cases where multiple 
cameras are used, if form data obtained by each camera is 
composited, then it is not necessary to move the object or 
camera, and therefore it is possible to measure the overall 
form of an object by a single picture-taking. 
[0040] Explanation of the operation of an invention as in 
Claim 7. In cases where the form drastically rises from the 
reference plane without the contour of the object gradually 
changing from the reference plane, when the pattern light is 
hidden greater than one cycle due to surface variations 
between the object and reference plane, the phase is not 
accurately detected. Accordingly, measurement results for 
the top of the object surface show a relative value, and 
accuracy is lost for the calculated form. 
[0041] With regards to this type of object, when white and 
solid-color pattern light that is the same as regular 
illumination is projected onto an object, surface variations 
between the object and reference plane cause shadow 
sections to be produced. These shadow sections depend on 
the height of the object's border sections, the projector 
position and the angle of the pattern light projection, and if 
the position and projection angle are already known, then it 
is possible to know the contour position and height of an 
object from the images observed by camera. It is possible 
to limit the range of the measurements taken of forms by 
projection of slit pattern light, based upon the contour 
position of the object perimeter obtained from projections 
of pattern light from multiple projectors, and then the 
amount of operations for measuring the form when 
calculating the form for only the particular area is reduced. 
[0042] Explanation of the operation of an invention as in 
Claim 8. In cases where pattern light is projected against 
an object that has variations in its surface form, unlike the 
invention in Claim 7, shadows sections are produced on the 
surface of the object. It is possible to calculate the edge 
positions and heights of the variations on the object surface 
when these shadow sections are measured. Based- on this 
information, when connected to the amount of phase 
modulation calculated for all areas, it is possible to measure 
an accurate form by using the highs and lows of both sides 
of the edge positions for the calculated surface variations at 
connections that step over the shadow sections due to 
grading. . 
[0043] With inventions as in Claim 9, pattern light is 
projected against objects that have surface variations in 
their surface form, the contour positions and height of the 
object with the edge positions and heights that constitute 
the surface variations are calculated from the shadow 
information, and the planer shape of the object is divided 
by multiple areas that have the same height. When slit 
patterns for high-frequency elements are projected in the 
same way to improve the precision for pattern light in low 
sections of the object, the patterns become tight in high 
sections of the object, making it impossible to observe them 
as slit patterns. 

[0044] Thus, the frequency elements for slit patterns 
change corresponding to the heights of the divided areas. If 
it is possible to express them in terms of the frequency on 
top of the reference plane, then it becomes possible to 
observe the same slit pattern across all areas and calculate 
the form with the same precision, by projecting narrow slit 
patterns (high-frequency element slit patterns) for areas of 



low height and pattern light for wide slit patterns (low- 
frequency element slit patterns) at high areas. 
[0045] Explanation of the operation of an invention as in 
Claim 10. When the surface variations in the irregular 
parts on top of an object's surface become large, then the 
focus of the projecting lens of the projector and the focus of 
the lens of the observing camera cease to match. Thus, 
from the positions and heights of the edges of the irregular 
parts, and the positions and heights of the object's contours, 
the object surface is divided by -areas that have the same 
height. Therefore, a lens that has an electrical control 
mechanism is installed into the projector and camera, and 
the focus of the lens is adjusted by a CPU based on the 
height of each area. Based on this, it is possible to 
calculate the three-dimensional form of an object with 
uniformly high precision. 

[0046] Explanation of the operation of an invention as in 
Claim 1 1 . Projected pattern light cannot be accurately 
observed in sections where there is dirt, small holes, 
patterns, or coating on the object surface. These sections 
will affect other normally observable sections in the same 
manner, and when the form is calculated, not only these 
sections, but later connected phases also become 
indeterminate. 

[0047] Accordingly, in order to accurately detect sections 
of the object surface that have dirt or small holes, an 
unprojected image is obtained that is observed without 
projecting pattern light from a projector. This image can be 
obtained by observing an object which is being struck by 
external illumination such as a lamp, assuming that initial 
conditions are not in a complete darkroom state. In 
addition, it is also possible to obtain an image in a state of 
total illumination by projecting pattern light identical to 
normal illumination onto an object. 

[0048] Thus, the luminance difference for each pixel from 
among these images is calculated. If this difference is 
minute, then even in cases where pattern light is projected, 
it is not possible to observe changes in the pattern for these 
pixels. The three-dimensional form of the object is then 
calculated by determining form irregularities by first 
detecting the aforementioned sections and then removing 
the calculation results for the form in these sections, and 
then using only the data from the sections for which the 
form can be normally calculated. 

[0049] Explanation of the operation of an invention as in 
Claim 12, There are cases where the reason that projected 
pattern light was detected as unobservable areas due to 
factors such as dirt on the object surface originates from 
insufficient illumination. Therefore, with this invention, a 
lens that has an electrically controllable aperture is installed 
in the projector and camera, and then the aperture is 
adjusted along the direction that the illumination value 
(luminance) rises even greater than when the prior 
measurement was taken. At this point, the luminance 
difference is further calculated, and divided into areas for 
which observation is possible according to those areas 
where the pattern is unobservable irregardless of the 
illumination, as with small holes, and increases in 
illumination. From the image observed by increasing the 
illumination, the form of the areas that were deemed 
irregular the first time are calculated, and it is possible to 
obtain a uniformly accurate form by compositing the results. 
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[005O1 Explanation of the operation of an invention as in 
Claim 13. In cases where the measurement subject object's 
material is a lustrous material such as metal, pattern light 
projected from a projector is drawn out by irregular 
reflection. When the form of these reflected sections is 
calculated the same way as sections for which the pattern is 
normally observable, an . inaccurate form emerges. 
Therefore, with this invention, the sections that cause these 
reflections (sections where luminance is saturated) are 
detected beforehand. Then, patterns that are same as with 
regular illumination are projected, and images are obtained 
for total illumination conditions. From these images, the 
areas for which luminance is saturated are detected and 
when the form is calculated by projecting patterns, then it 
becomes possible to calculate the form accurately by 
deleting the information from the areas where luminance is 
saturated. 

[0051] Explanation of the operation of an invention as in 
Claim 14. With areas that produce irregular reflections, the 
luminance is saturated for a range even wider than the 
sections that are actually causing the reflections. Therefore, 
with this invention, a lens that has an electrically 
controllable aperture is installed in the projector and 
camera, and then the aperture is adjusted along the 
direction that the degree of illumination (luminance) drops 
more than the previous time. Here, the areas where 
luminance difference is saturated are limited, and are 
divided by areas where it is possible to observe by dropping 
the illumination. From the images observed by dropping 
the illumination, the form of areas that were deemed 
irregular the first time are calculated, and it is possible to 
obtain a uniformly accurate form by compositing the results. 

[Working examples of Invention] The following is an 
explanation of working examples of each invention with 
reference to drawings. Fig. 1 is a block drawing showing a 
working example of this invention, and we will describe a 
working example of an invention as in Claim 1 while 
referring to this drawing. First, 101 are the reference plane 
and object 102 - which is the subject for three-dimensional 
form measurement - is placed on top of it. A color camera 

103 for making observations is placed right above the 
object 102, and a projector 104 for projecting pattern light 
is placed at a diagonally upward direction. This projector 

104 is equipped with a light source and lens, the same as 
with a slide projector, displays patterns that have arbitrary 
color and intensity onto a color liquid crystal panel built 
into the projector, and can project pattern light based on 
these patterns onto the object 102. 

r0053] The slit pattern data projected onto object 102 is 
created by a CPU 109 in three frame RGB parts in partem 
memory 107. One frame out of these is composed at 8 bits 
to a pixel, and the slit patterns are composed so that light 
bands 201 and dark bands 202 are lined up alternating at 
fixed intervals, as shown in Fig. 2 (A). The data for x 
coordinates for the line 203 for which the y coordinates is j 
in Fig. 2 (A) is shown in Fig. 2 (B). The data g(x) for the x 
coordinates on this line 203 is created by Formula 2. 
[0054] 

[Formula 2] g(x) = 1 28 x sin (x/a • n) + 1 27 

[0055] Here, assuming a range of 0 <, g(x) £ 255, the cycle 

of the slit pattern is determined by a. Assuming that a is a 



number greater than one, low-frequency sine wave patterns 
in cases where it is large, and high-frequency sine wave 
patterns in cases where it is small, are created. 
[0056] When the same pattern, but each with different 
frequencies, is created on the three RGB framKofthe 
pattern memory 107, then the x coordinate data 301, 302, 
303 on each line 203 of these three frames becomes as m 
Fig 3 Here, against data 301, 302 has 1/2 times, and 303 
has 1/3 times the frequency elements. These three frames 
correspond to color RGB, and the data composed for data 

301 302 and 303 becomes as in Fig. 4. 

[0057] In Fig. 4, at the point at which the values for 
composed data for all RGB frames reaches maximum the 
pattern light is projected onto the object as wh.te. 
Conversely, if all RGB frame data 301, 302 and 303 are 0, 
as at the point 304 in Fig. 4, then at this point, the pattern 
light is projected onto the object as black. The data 301 

302 and 303 for the three RGB frame parts for this kind of 
pattern memory 107 is transmitted to the color liquid 
crystal panel of the projecting projector 104 in Fig. 1 as 
pattern data, and then color pattern light is projected onto 
the surface of the object 102 from a light source built into 
the projector 104, via the projecting lens. 

[0058] Pattern light projected onto the object has its picture 
taken by a color camera 103, and then this image is 
converted into digital image data by an A/D converter 05. 
This digital image data is stored in frame memory 106. 
This image becomes a transformed lattice image that has 
been altered by the three-dimensional form of the object 
102 Since the color transformed lattice images are saved 
in the RGB frame for frame memory 106 the same as with 
picture-taking, if the projected patterns are created on RGB 
per each one pattern, then they will come to be saved as 
transformed lattice images per frequencies projected onto 
the RGB frame of frame memory 106. Specifically, 
separation into color elements identical to picture taking is 

carried out. . 
[0059] If these projected patterns are three patterns, then it 
is possible to color separate at the same time as picture 
taking by using RGB, but in cases where projection is done 
by composing patterns greater than four, then hues are 
provided to each pattern. In the case of composition, 
composing is done after converting hue information into 
RGB and then it comes to be stored in pattern memory 107. 
At this time, the hues provided to each pattern are made to 
be mutually exclusive. . 
[0060] Specifically, in cases where a picture is taken of this 
pattern and the color is separated, since there comes to be a 
conversion from RGB to hue, it is necessary for RGB to be 
combinationally exclusive so that whatever pattern there is 
at that time is divided. In cases where there is a projection 
of a pattern composed in this way, the color-separated 
image will be stored in the memory as a work area 108. 
Furthermore, in Fig. 1 , 1 10 is the D/A converter, and 1 1 1 is 

the display. . 
[0061] Fig. 5 shows the luminance on one line ot a 
transformed lattice image created by a high-frequency 
element pattern out of color-separated patterns. The rising 
sections of the object 501 surface on this line have an 
originally two-cycle part pattern projected, but since the 
pattern is being compacted in the sections 504 
corresponding to the rising sections 502 in the image 503 
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observed from the camera, it is not possible to observe it as 
a two-cycle part. 

[0062] For example, with regards to using methods for 
obtaining the amount of phase modulation as a form 
measurement technique, the form of the rising sections 502 
become like 601 in Fig. 6, and then calculations are done 
for a form that differed from 602, which is the original 
form. On the other hand, gaps are produced in the rising 
sections 502 as in 701 in Fig. 7 from the transformed lattice 
images created by pattern projections of low-frequency 
elements against the same line. However, errors from sine 
wave patterns due to the lengthening of the cycle pitch 
become great in pattern projections for low-frequency 
elements, and although it is possible to grasp the overall 
form, there is partial loss of form measurement precision. 
[0063] Accordingly, it was decided to gradually calculate a 
precise form from the general form and then correct it, and 
then calculate the original form 602 in Fig. 6 and Fig. 7, by 
projecting pattern light for different frequency elements. 
Specifically, the macro-form is calculated from the pattern 
light for low-frequency elements, and then the missing 
macro-form information sections are corrected using 
pattern light for high-frequency elements. As a result, the 
rising sections 502 in Fig. 5 are corrected, and the original 
form 602 shown in Fig. 6 and Fig. 7 is calculated. 
Furthermore, as for methods for calculating the form, 
Fourier transform method, electron moire* method, and 
stripe scanning moire method are all acceptable. 
[0064] Next, an explanation of a working example of an 
invention as in Claim 2. The x coordinate data g(x) on one 
line creates compositional pattern data as shown in Fig. 8 
as projection pattern data. For the data 1001 in Fig. 8, a 
phase difference of tc/2 is held at 1002, n at 1003, 3ti/2 at 
1004, with all of them having the same frequency. A 
specific hue is provided and composed for this data, 
converted into RGB, and then stored in pattern memory 
107. 

[0065] Pattern light based on the aforementioned 
compositional pattern data is projected by a projector 104, 
an RGB transformed lattice image observed by a color 
camera 103 is divided by hue when a pattern has been 
created, and stored in memory 108. The amount of phase 
modulation for each pixel is calculated from among these 
transformed lattice images, and then the three-dimensional 
form of the object is calculated. 

[0066] Fig. 9 and Fig. 10 show a working example of an 
invention as in Claim 3. In this working example, multiple 
color cameras are radially configured around an object so 
that it is possible to observe the object from multiple 
directions. Color cameras 1201 and 1202 are configured on 
both sides of the color camera 103, as shown in Fig. 8, and 
it is made so that the optical axis of each camera 103, 1201, 
1202 matches on the reference plane 101. Here, the form 
of the areas 1204, 1205 on both ends of the object 1203 
cannot be observed by the central color camera 103. 
[0067] Accordingly, it is good if the form of the object is 
calculated from the images observed by each camera 103, 
1201, 1202 by projecting pattern light onto the object 1203, 
and then having the areas for 1204 and 1205, which cannot 
be observed with the central color camera, and 103 
supplemented with an image observed by the color cameras 



1201 and 1202 on both sides. Furthermore, it is acceptable 
if the number of color cameras be greater than three. 
[0068] Regarding picture-taking of the object 1203, it is 
acceptable if each camera 103 and 1201, independent A/D 

converters 105 and 105 A for , and frame memory 

106 and 106 A are installed as shown in Fig. 10 (A) 

and image input is carried out in parallel, or if images are 
sequentially input by controlling via a CPU 109 a changer 
1301 that has been installed between the color cameras 103 

and 1201, and the A/D converter 105, with the 

assumption that the A/D converter 105 and frame memory 
106 make up a single system as shown in Fig. 10 (B). 
[0069] Fig. 1 1 is a working example of an invention as in 
Claim" 4, and shows the composition of the observation 
component in cases where the planer shape of the object 
1403 that is the subject for measurement is large. In order 
to maintain uniform resolution, multiple color cameras 103, 
1401 and 1402 are set up in parallel upwards of the object 
1403 at the same height, and then observations are made 
through multiple divisions of the measurement area. Even 
in this case, it is acceptable if the number of color cameras 
is greater than three. The measurement areas are 
determined according to the height and planer shape of the 
object 1403, so that mutually overlapping areas are created. 
It is acceptable if the input system from the cameras 103, 
1401 and 1402 is either by parallel input or sequential input, 
as shown in Fig. 1 0. The form is calculated and results 
composed for each picture-taking area of the object 1403 
based on the observed images according to each camera 
103, 1401 and 1402, and then the three-dimensional form 
of the overall object is measured. 

[0070] Fig. 12 is a working example of an invention as in 
Claim 5, which is one in cases where the object 1502 is 
projected from different directions by multiple projectors. 
In Fig. 12, the primary projector 104 and secondary 
projector 1501 are radially configured against the object, 
with the color camera 103 placed between. The optical 
axes of the color camera 103 and projectors 104 and 1502 
match on the reference plane 101. Here, it is acceptable if 
the number of projectors ^exceeds two. 
[0071] With the pattern light projected by the primary 
projector 104, since the areas 1503 of the object 1502 are 
blocked by the object 1502 itself, the pattern light is not 
projected onto the surface of the area 1503. With regards 
to this area 1503, it is observed by the color camera 103 by 
projecting pattern light from the secondary projector 1501. 
[0072] With regards to the projections from projectors 104 
and 1501, independent pattern memory 1601 for the 
secondary projector is installed as in Fig. 13 (A). Thus, 
patterns are created that have different color elements from 
the primary projector 104 for the secondary projector 1501 
and stored in pattern memory 1601, are simultaneously 
projected by the projectors 104 and 1501 by using the 
pattern data of pattern memory 107 and 1601, and then the 
color elements are separated by observing the transformed 
lattice images with the color camera 103. 
[0073] In addition, it is also acceptable if a changer 1602 is 
installed between the projectors 104 and 1501 and a single 
pattern memory 107, as in Fig. 13 (B), and pattern light 
from projector 104 and pattern light from projector 1501 
are switched and sequentially observed. In this way, the 
form of each part of the object 1502 from each parallel or 
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sequentially input image is calculated, and then it is 
possible to measure the three-dimensional form of the 
overall object by subsequent image composing. 
[0074] Fig. 14 is a working example of an invention as in 
Claim 6, which is one for cases in which the planer shape 
of an object 1701 that is the subject for measurement is 
large. In this working example, each pattern light is 
projected from different directions by dividing the 
projection area for the pattern light against the object 1701 
from a primary projector 1702 and a secondary projector 
1703, juxtaposed against the object 1701. Furthermore, it 
is acceptable if the number of projectors exceeds two. 
[0075 ]The projecting areas are determined by accounting 
for the height and planer shape of the object 1 701 that is the 
subject, so that mutually overlapping areas are created. It is 
acceptable if the projections from each projector are 
simultaneous or sequential projections as in Fig. 13. The 
pattern light projected from each projector 1702 and 1703 
is observed by a color camera 103, then the form is 
calculated and results composited for each area of the 
object from the obtained images, and then the three- 
dimensional form of the overall object is measured. 
[0076] In this working example, it is acceptable if the 
multiple color cameras are configured as in Fig. 9 and Fig. 
11. In such cases, if form data observed by each camera is 
composited, then it becomes possible to measure the 
overall form of the object 1701 with a single picture-taking 
without moving the object 1701 or the camera. 
[0077] Fig. 1 5 shows a working example of an invention as 
in Claim 7. In this working example, the object contours 
do not gradually change from the reference plane, however, 
the invention is one for accurately measuring this, even in 
cases where the form is one for which there is a drastic rise 
from the reference plane. In Fig. 15, in cases in which the 
form of an object 1801 on a reference plane 101 is 
measured, when pattern light projected from a primary 
projector 104 is projected so that all RGB are at maximum 
luminance, specifically, composited pattern light becomes 
solid white, shadow sections 1802 are produced by surface 
variations between the reference plane 101 and object 1801. 
These shadow sections 1802 are dependent on the height 
1803 of the contour positions of the object 1801 and the 
position and pattern light projection angle of the projector 
104. 

[0078] These conditions are observed by a color camera 
103 and then an image is taken. Then, the contour 
positions and height 1803 of the object 1801 are calculated 
from the configuration of a known optical system (position 
and projection angle of the projector 104). In addition, if a 
secondary projector 1804 is configured on the opposite side 
of the primary projector through the color camera 103, then 
it is possible to calculate the contour positions and height 
1805 on the opposite side of the object 1801. By 
configuring multiple projectors in the same manner, it is 
possible to obtain the contour positions and height of the 
overall object. 

[0079] Next, pattern light that constitutes slit pattern data is 
projected and observed by the color camera 103. Then the 
form is calculated only for the areas that exist for object 
1801 from the contour positions of the object 1801 detected 
against the image taken. The form calculated from this is a 
relative value of the object surface as shown in Fig. 16 (A), 



so by tempering this data against the data in Fig. 16 (B) for 
the previously detected contour position height, final form 
data is obtain as shown in Fig. 16 (C). Based on this, it is 
possible to accurately detect the three-dimensional form 
even for an object 1 801 that has a form for which there is a 
drastic rise from the reference plane. 
[0080] Fig. 17 shows a working example of an invention as 
in Claim 8. This working example is one in which the form 
of an object that has variations in its surface is accurately 
measured. As in Fig. 17, in cases where variations 2002 
exist in the surface of an object 2001, when the previously 
described white and solid-colored pattern light is projected 
from a primary projector 104, shadows sections 2003 are 
produced from the aforementioned surface variations 2002. 
When an image is taken by observing these conditions with 
a color camera 103, then it is possible to calculate the edge 
positions and height 2004 of the surface variations 2002 
from the configuration of a known optical system. 
[0081]The shadow sections 2003 are produced by 
projections from the projector 104, but if white and solid- 
colored pattern light is projected from the secondary 
projector installed on the opposite side, then it will not be 
possible to observe the shadow sections 2003. From this, it 
is understood that the left side of the surface variations 
2002 will be high, while the right side will be low. In this 
way, when calculations are made from among the images 
observed by projecting pattern light from multiple 
directions by multiple projectors, then it is possible to 
detect the highs and lows of the object surface on both 
sides of the edge positions of the surface variations 2002. 
[0082]Next, pattern light that constitutes slit pattern data is 
projected from projectors 104 and 2005, and then observed 
by the color camera 103. The form is calculated from the 
image taken by the camera 103, and then the form is 
calculated from the patterns projected by the projector 104, 
along a direction for which observation of the shadow 
sections is possible, based on the previously detected 
information about the shadow sections 2003 of the detected 
object 2001, and then the three-dimensional form of the 
object is determined by adjusting the overall form based on 
these calculation results. 

[0083] Fig. 18 shows a working example of an invention as 
in Claim 9. This working example is one in which the form 
of an object that has irregular surface variations in its 
surface is accurately measured. The edge positions and 
height are detected for an object 2101 that has variations in 
its surface as in Fig. 18, according to the contours and 
surface variations of the object 2101, the same as in Fig. 15 
and Fig. 17. Based on this information, the planer shape of 
the object 2102 is divided into multiple areas 2201, 2201 
and 2203 as shown in Fig. 19, according to contours and 
edges that have the same height. 

[0084] Here, when pattern light of a single frequency is 
projected onto the object 2102, then the pattern pitch on the 
area 2202 becomes 2301, as shown in Fig. 20, and the 
pattern pitch on the area 2201 because 2302. In cases 
where this frequency is appropriate for the area 2202, the 
pattern pitch narrows in area 2201, which is even higher 
than this area 2202. Accordingly, in cases where the form 
is changing within area 2201, then the pitch further 
compacts, and then it is not possible to observe it as a cycle 
partem. 
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[0085] In these cases, the edges are calculated from the 
average height per area, and then pattern light that has low- 
frequency elements corresponding to these heights is 
projected per area. The three-dimensional form of the 
overall object is then calculated by calculating and 
compositing the form per area based on projected pattern 
light In addition, it is acceptable if the frequency of the 
projected pattern light increases for the inverse height is 
low. 

[0086] Next is an explanation of a working example of an 
invention as in Claim 10. When the differences in 
elevations and the differences of elevation with the 
reference plane reach maximum on the object surface, then 
the patterns that are image-formed through lenses 
according to the height of the object are shaded off, and 
shading-off occurs even for picture-taking by the camera. 
In the setup shown in Fig. 21, regional division is taking 
place the same as in Fig. 19 for an object 2101 that has 
surface variations as shown in Fig. 1 8. The average height 
of the edges of these areas is calculated for each divided 
area, and then the amount of adjustment of the focus is 
determined by CPU 109, or the amount of adjustment of 
the focus based on height is saved in memory 108 as table 
data beforehand. 

[0087] In Fig. 21, the amount of adjustment determined as 
in the above is transmitted to an interface 2405 for 
controlling the focus, and then the focus is adjusted through 
operation of a drive system for focus adjustment of the 
lenses 2402, 2403 and 2404 for the camera 103 and 
projectors 104 and 2401. In addition, the number of 
divisions of area for calculating form is determined by 
adjusting the focus according to the precision required. 
[0088] When the areas divided by the planer shape of the 
object are 2201, 2202 and 2203 as in Fig. 19, each of these 
areas are handled as the same area, and the form of the 
object is calculated by a single picture-taking at a focus set 
as an initial condition. In cases where further high 
precision is demanded by conditions, then the areas are 
handled as the same area since the height between area 
2202 and 2203 is relatively close, and then the object form 
is calculated according to a single focus adjustment and 
double pattern observations. All of the areas 2201-2203 
are handled similarly as individual areas with different 
heights, and the object form is calculated according to 
double focus adjustments and triple pattern observations. 
The number of times these focus adjustments and pattern 
observations are carried out can be arbitrarily selected 
based on the time and detection precision provided by the 
form measurement process. 

[0089] Next is an explanation of a working example of an 
invention as in Claim 1 1 . Cases in which there is dirt 2502 
or small holes 2403 on a single line 2501 on the object 
surface as in Fig. 22 (A) are considered. When pattern 
light is projected onto this surface, then the luminance that 
corresponds to the dirt 2502 and holes 2503 becomes like 
that in areas 2504 and 2505 in Fig. 22 (B) respectively. 
[0090] When the form is calculated from these types of 
patterns, then the form becomes irregular for parts of the 
areas 2504 and 2505, and it is not possible to accurately 
obtain an accurate overall form if the form remains 
connected in this manner. Accordingly, measurements are 
first taken under non-projected conditions in which no 



pattern light is projected from any projector. The 
luminance of the line 2501 at this time becomes 2601 in 
Fig. 23 (A), and the luminance for cases in which white and 
solid-colored pattern light is projected from each projector 
becomes 2602. This time, in the areas 2603 and 2604 that 
correspond to dirt 2502 and holes 2503, the difference 
between luminance 2602 and 2601 becomes small. 
[0091]Specifically, in areas 2603 and 2604, even when 
pattern light is actually projected, it is not possible to 
observe it as a pattern. In addition, since it is like areas 
2603 and 2604 are produced with projections from any 
directions, it is understood that these areas 2603 and 2604 
are not due to surface variations. 

[0092] The luminance in cases where pattern light based on 
slit pattern data is projected becomes like 2605 in Fig. 23 
(B). In cases where luminance is analyzed at frequency 
domains, since areas 2609 and 2610 (areas 2603 and 2604 
in Fig. 23 (A)) become noise element data, the data for 
areas 2609 and 2610 is removed from the luminance 2605 
data. Accordingly, individual forms are calculated within 
the areas 2606, 2607 and 2608 in Fig. 23 (B). 
[0093] When the final three-dimensional form of the object 
is determined, areas 2606, 2607 and 2608 remain connected 
as is, if it is known, for example that the object surface is 
basically flat, and then the final results are taken with the 
assumption that parts of areas 2609 and 2610 remain as 
form irregularities. In cases where parts are not assumed to 
be form irregularities as described above, with regards to 
the final results, a means for correcting the connection on a 
straight light is determined beforehand for the removed 
parts (areas 2609 and 2610), and then corrective action is 
undertaken. 

[0094] In addition, in cases where there is no information 
that becomes a presupposition for determining the final 
form, pattern light that has a sufficiently longer cycle than 
the width of the previously described dirt 2502 and holes 
2503 is projected, forms calculated from the relative areas 
2606, 2607 and 2608 by obtaining the positions for 
2701-2704 in Fig. 24 are connected, and then it is possible 
to determine the overall form of an object. Furthermore, it 
is possible to apply this working example to cases in which 
patterns and coating are present on the object surface. 
[0095] Next is an explanation of a working example of an 
invention as in Claim 12. In this working example, the 
luminance is increased greater than during the previous 
form measurement for areas where the form is irregular due 
to dirt, small holes or patterns on the object surface, as 
shown in Fig. 22. Specifically, the aperture of the lenses 
2402-2404 is adjusted by the interface 2405 shown in Fig. 
21, and the amount of incident light for the projected 
pattern light and camera 103 is increased. 
[0096] Here, the unprojected luminance for which pattern 
light is not projected by some projector, and the luminance 
in cases where solid-colored pattern light is projected as 
white from each projector, become as with 2801 and 2802, 
respectively, in Fig. 25. Even if the luminance is increased 
for the area 2804 in Fig. 25 (corresponding to areas 2604 
and 2610 in Fig. 23 due to holes 2503 in Fig. 22), the 
luminance difference for 2801 and 2802 is minute, and it is 
not possible to measure even by projecting pattern light. 
On the other hand, the luminance difference for 2801 and 
2802 is increased for area 2803 (corresponding to areas 
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2603 and 2609 in Fig. 23 due to dirt 2502 in Fig. 22), and if 
pattern light is projected under these conditions, then it is 
possible to take measurements. 

[0097] Fig. 26 shows the luminance when pattern light 
based on slit pattern data has been projected. Even in the 
parts where there is dirt 2502 in Fig. 22 where 
measurement was not possible the first time, patterns are 
observed in the area 2901 in Fig. 26, and the form is 
calculated. By tempering this form with the form obtained 
the first time, it is possible to measure accurately this form 
even with objects that have dirt on the surface. 
[0098] Next is an explanation of a working example of an 
invention as in Claim 13. This working example is one for 
cases in which an object is measured for which the 
reflection of projected pattern light is strong against its 
surface, which is composed of a lustrous material such as 
metal. In Fig. 27 (A), when the pattern light is projected 
onto an object 3001 composed of material that has strong 
reflection against its surface, the change in luminance 
becomes as with 3003 in Fig. 27 (B). 
[0099]This time, the luminance observed at an inclination 
3002 positive to the projector 104 becomes 3004 at the area 
3006 in Fig. 27 (B), and since the saturated state will 
continue at high luminance, changes as a pattern cannot be 
obtained. Accordingly, it is not possible to measure 
accurately the three-dimensional form of an object while 
areas such as 3006 remain included. 
[0100] Therefore, when solid-colored pattern light is 
projected as white from a projector 104, the luminance 
reaches 3101 in Fig. 28. As a result, the three-dimensional 
form of the object is calculated by projecting pattern light 
only for the areas 3005 and 3007 where there are surface 
variations from the maximum luminance 3102. This time, 
process the area 3006 that corresponds to the inclination 
3002 as a remaining irregular area. 

[0101] Next is an explanation of a working example of an 
invention as in Claim 14. In this working example, the 
luminance is reduced for the area 3006 that was determined 
to be a form irregularity in Fig. 28. The aperture of the 
lenses 2402-2404 is controlled by the interface 2405 in Fig. 
21, and then the quantity of light for the projected pattern 
light and camera 103 is reduced. Here, when solid-colored 
partem light is projected from a projector as white against 
the object 3001, the luminance becomes as with 3201 in 
Fig. 29. The luminance difference with the maximum 
luminance 3102 at the area 3006 previously determined to 
be a form irregularity is increased, and then it is possible to 
obtain changes for patterns. 

[0102] Changes in luminance when pattern light based on 
slit pattern data is projected under these conditions are 
shown as 3301 in Fig. 30. At the area 3006, changes in 
luminance are obtained, and it is possible to calculate the 
form for this area. By compositing the form calculated in 
the first measurement, and the form calculated here, it is 
possible to obtain the overall form of the object. In 
addition, it is acceptable if there is removal of the data for 
when the form is calculated for areas in which the 
luminance is saturated even if the luminance is reduced, 
and then processed for those areas as form irregularities. 
[0103] 

[Effects of Invention] According to the invention in Claim 
1 described above, color pattern data is created by 



compositing multiple sinusoid slit pattern data of different 
frequency elements, and then by separating the transformed 
lattice images into color elements by projecting pattern 
light based on this data, it is possible to measure the three- 
dimensional form of a an object with drastic changes in a 
short time and with high precision, from a single 
observation; specifically, a single image. 
[0104] According to the invention in Claim 2, by color 
separating the transformed lattice images by projecting 
pattern light based on multiple sinusoid slit pattern data that 
have the same frequency elements and offset phases, it is 
possible to obtain the amount of phase modulation in each 
pixel from among the images for each pattern data that has 
offset phases from a single image, and it is possible to 
measure the three-dimensional form of an object in a short 
time with high precision. 

[0105] According to Claim 3, it is possible to mutually 
interpolate and match the forms by observing an object 
from multiple directions with multiple cameras, and then 
measure the three-dimensional form with high precision. 
[0106] According to the invention in Claim 4, it is possible 
to measure the form of an object that has a size greater than 
a single camera's field of view, or a spherical object, 
through multiple divisions of the measurement range of the 
object by using multiple cameras. 

[0107] According to the invention in Claim 5, it is possible 
to eliminate the areas not touched by pattern light because 
of blocking by the object itself, by projecting pattern light 
from multiple directions from multiple projectors against 
an object, and measure a form without omissions through 
projectors from different directions. 
[0108] According to the invention in Claim 6, it is possible 
to measure without omissions the form of an object that has 
a size greater than the projection area of a single projector, 
or an object that has a curved surface, through multiple 
divisions of the object's projection area by using multiple 
projectors. 

[0109] According to the invention in Claim 7, shadow 
sections caused by surface variations between the reference 
plane and object by using multiple projectors are detected, 
and then the contour positions and height are detected in 
these shadow sections. Based on this information, since the 
form is measured only for areas where the object exists, it 
is possible to reduce the processing time. In addition, since 
the amount of surface variations is tempered against the 
calculated object form, it becomes impossible to observe 
the pattern light projected at stepped sections at any cycle, 
and it is possible to measure accurately the three- 
dimensional form of the object. 

[0110] With the invention in Claim 8, before pattern light is 
projected according to slit pattern data for form 
measurements of an object that has variations in its surface, 
pattern light that is the same as normal illumination is 
projected from multiple directions, the height at the edge 
positions of surface variations is detected from the 
projection angles of pattern light, and the highs and lows on 
both sides of the edge positions are detected from the 
projection direction of the pattern light. Based on this, it is 
possible to measure accurately the overall form, even with 
objects that have variations in their surface. 
[0111] With the invention in Claim 9, an object is divided 
into multiple areas of the same height by using the contour 
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positions and height of the object detected beforehand, and 
the edge positions and heights of the surface variations on 
the object surface, and it is possible to measure the form at 
the same precision at any height, by projecting pattern light 
that has a cycle that corresponds to the height of these areas. 
[0112] With the invention in Claim 10, it is possible to 
measure the form with greater high precision, by adjusting 
the focus of the camera and projector lenses to correspond 
to the height of each multiply divided area. 
[0113] With the invention in Claim 11, it is possible to 
measure the three-dimensional form of an object based on 
data obtained from areas other than those determined to be 
form irregularities from among areas in which information 
on dirt, small holes and patterns in the object surface were 
detected beforehand. 

[0114] With the invention in Claim 12, it is possible to 
reduce the areas assumed to be form irregularities by 
adjusting the aperture of the lenses of the camera and 
projector for those areas determined to be form 
irregularities with low luminance for observed pattern light, 
and then re-measuring the form only for those areas. 
[0115] With the invention in Claim 13, it is possible to 
measure the three-dimensional form of an object based on 
data obtained from areas other than those determined to be 
form irregularities from among areas in which areas of 
saturated luminance where the projected pattern light 
reflects on the object surface were detected beforehand. 
[0116] With the invention in Claim 14, it is possible to 
reduce the areas assumed to be form irregularities by 
adjusting the aperture of the lenses of the camera and 
projector for those areas where the luminance of pattern 
light projected by reflections on the object surface is 
saturated, and then re-measuring the form only for those 
areas. 

[Brief Description of Drawings] 

[Fig. 1] A block drawing showing a working example of 
this invention. 

[Fig. 2] An explanatory drawing of the slit pattern and 
data on one line. 

[Fig. 3] An explanatory drawing of data for the three 
RGB frames. 

[Fig. 4] An explanatory drawing of composite data in Fig. 
3. 

[Fig. 5] A drawing showing the luminance of transformed 
lattice images caused by high-frequency element pattern 
light. 

[Fig. 6] An explanatory drawing of form measurement 
errors. 

[Fig. 7] A drawing explaining form measurement errors. 
[Fig. 8] An explanatory drawing of composite pattern 
data. 

[Fig. 9] A block diagram of the observation component in 
a working example of this invention. 
[Fig. 10] A block drawing of the important parts in a 
working example of this invention. 

[Fig. 1 1 ] A block diagram of the observation component in 
a working example of this invention. [Fig. 12] A block 



diagram of the observation component in a working 
example of this invention. 

[Fig. 13] A block drawing of the important parts in a 

working example of this invention. 

[Fig. 1 4] A block diagram of the observation component in 

a working example of this invention. 

[Fig. 15] A block diagram of the observation component in 

a working example of this invention. 

[Fig. 16] An explanatory drawing of form data measured 

in a working example of this invention. 

[Fig. 17] A block diagram of the observation component in 

a working example of this invention. 

[Fig. 1 8] A block diagram of the observation component in 

a working example of this invention, 

[Fig. 19] An explanatory drawing of the divided areas of 

the object planer shape in a working example of this 

invention. 

[Fig. 20] An explanatory drawing of the pattern pitch in a 
working example of this invention. 

[Fig. 21] A block diagram of the observation component in 

a working example of this invention. 

[Fig. 22] An explanatory drawing of the condition of the 

object surface and luminance in a working example of this 

invention. 

[Fig. 23] Explanatory drawing of luminance in a working 
example of this invention. 

[Fig. 24] Explanatory drawing of luminance in a working 
example of this invention. 

[Fig. 25] Explanatory drawing of luminance in a working 
example of this invention. 

[Fig. 26] Explanatory drawing of luminance in a working 
example of this invention. 

[Fig. 27] An explanatory drawing of the observation 
conditions and luminance in a working example of this 
invention. 

[Fig. 28] Explanatory drawing of luminance in a working 
example of this invention. 

[Fig. 29] Explanatory drawing of luminance in a working 
example of this invention. 

[Fig. 30] Explanatory drawing of luminance in a working 
example of this invention. 
[Explanation of Codes] 
101 Reference Plane 

102, 501, 1203, 1403, 1502, 1701, 1801, 2001, 2101, 3001 
Object 

103, 1201, 1202, 1401, 1402 Color Camera 

104, 1501, 1702, 1703, 1804, 2005, 2102,2401 Projector 

105, 105AA/D converter 

1 06, 1 06 A Frame Memory 

107, 1601 Pattern Memory 

108 Memory 

109 CPU 

1 10 D/A converter 

1 1 1 Display 

1301, 1602 Changer 
2402, 2403, 2404 Lens 
2405 Interface 
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[Fig. 11] 



[Fig. 12] 
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[Fig. 18] [Fig. 20] 
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x+<Kx,y)) 

[0 0 1 0 3. ccr. *»«#©»tt*SRLi , ri>4til 

C©***»4C£3Wr*tltf»tt*»a-r 

^te (^CCj;-Dr«-7t/2^*^7C/ , 2i§iT,r^ 

tgT>7 7 (K. Itoh : "Analysis of the 

phase unwappinq algorithm" , APPLIED OPTIC 
S, Vol.21. No.14. pp2470 (1982) #M) tmtt\i>1j 

sfciic j^nu m.bicm&w>*mz>. *b 

X. mMKfcfttbX. *y5«6jBttif©jt*»tt 
m<%* & 1 K . ttffl*ffilBrtr ©«Jft©=iJ?7cJI5ttK 

[ooi i ] cne.©^«, itc«B0g«©sEib*»ft 

[0 0 12] 

[2fi3B#8?&l><fc 5 ttmm) ±aS0A:J: 5K^»- 

bxmw<o^7m^mmt ^mmsfc 

tt. ;K©«fcVj:nW>WKET*. 

0 1 @©^*->SR"C»«»*lii©«itttt»b*IHIJ 

s«»Ktt*. »fl*»±UT^5tt(B"T?©fHWl/3Mfit 

«ti»fc». £&tnu9m j pmmc&< ©n*nn#**»s. 
[ooi3] ®iwtaffl©}i5ttafk3Wfttt"r**4. » 
wctsi? § n/c^- >5fe*i«}{*«: <fc o iiSi s n -s fc* 

2M7-Ct«r 7n$/x*$r#>6©A* 

^ 5 ©S» 7* a s? x * * ©ftlHgHU: 
9fc**t,»4. 10©><*->«#r«aX£IHH-C* 
r. «ft*A:tt**JR**»8"tt*!S»*J*4. C©» 
^MffiST©«lft^©tt«ISft(cMftfti£D^ 

[0014] ®«tittfSW&&&¥iifcBfeWdj^ 
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ftiS'Jf *©IB«Hi*(*4©g»rtK-i«l!« 
±©<**->**W4rtL*5i. etB3n^ft©JfJ 

©^ttaHic^aTsiaej*^ ^miKomm\ silk 

[0015] ©»ffi±«c||^*3»ft©*<r>»»r 
«. S ttfc'< * - >36©*H*affi«:* W 6 f » 9^*5 

fii>«»r©flia»»^tr*. 
amtotwvmtoB&p, *rt*«iH±r©ga&&9Mr 

tc^c* o*g^. *y 5Ttt*CfcK#©*o£*fft*t,fc 
[0.0 1 6 ] ®«J»j«i'C©ll*W*l. ^&©?L&4' 

{c«tosiJorc^^^>^©^b*^tasnr, -en?. 

©WHoWIJf 8 -* *£»rlMtett©»R**a-r * 

8rt-*»^tctt*©a^*fflsti-s'» **i6©*«© 
wwf-i'*^f»"r*#^©jiJtt*jwir*i. iess 

[0017] #isBj3«±fE«*©isig£js?&Tsrc«>K: 
»t«3E{b^iHia-*>sa. rati. i&tt©**§. tt 

Wf©*<r*»H«:«t)6r. IH^ojBa«:«rt*©= 

4&C&S. ' 
30 ' [ 0 0 1 8 ] 

». mmi&wt®ftwte> **©anBCtt*»«-r-5 

•T4A*->*©A*->f t -**«WW*-' , «*->-»» 
40 *U4. fMI«WliUT©y*y4. i^JHi&T* 

■rs^x^u^i. *»©w»aDf«»*«fr*c 

PU4*»Afc^©=^^tWHWBtlI«:*»i»r. 51 
tt4jafiS^»svej^*»-o«»©i?sj^©x y 

l/. c©^-$->f r -5'(cS^<>'^->3K i &«)f*«ctS: 

^ae&©^^m*6tt{tt>^£ft(H 

50 L. C©||[tUt6j|l«tt^Uft:4>©«Aim4c1M4:©H% 



[0019] ffiiimm®£ffi&iT2>tcit>. a*Ji2iBis 

-A^-tHi. #7-#y5£«:g&.£#|6HC6Bg3ft 
n^xi^i, :/pyx**jfce>fiS*-r-5;<*-->3fc© 

4£r-*K»-r£D/AgglS|S<i. D/A^SP*^ 
ffi^J 3 ft £ T * a ^Itfftx- £ £ r -< X 7 b 4 

t . ^©wapse* a**gtfr-r scpui 

*flift«:SKbrfllfcab«HFiBfli*feS»Ci tc#g 
[0020] H5fE^S©?r^TS/cfe. ffi$J93£lB 

Ji^-r s «t ^ (cffi&£© # 5 - # > 7 «»(«4c» t, r 

ffi'J 3 ft/cjfjttf 7 - * «ltt©=ac7C«tt*ff IH 

TS. 

[0 02 1 ] ftTE!SB9&j!&rt-*fc&. il*S4iEiS 
©»0!tt. HWBBi*fctt2K*»t»T. »ft©¥ffiW& 

i'J3 ft/tffJtKr- jr «^ or «»©=^5c»tt*JWj 

[0022] mismm®*M&i-r n$5 stent 

©^HJ«. SftftBl. 2*fctt3Kltl>t. 4Mt<C$£ 

©7"a^x*££fifcWt£K:iBgU ^7*ai/i^^^e> 
©/<*->#«: J: * a y ? «*JB«(c*-^i» rSHIS ft 
/dfcttr- Z1p 6ft*©=^5c^«*»ia"r 4. 
[0023] ^ERBO^JBft-r Sfcft. IiWaS6fBiS 40 
©IMHtt. M&91. 2. 3£fctt4(c*i>?. %&ic 
«r 4^*->*©Tiimte»igttii%^«-rs J: 5 k 
tBte©^os?x*ji *ftflac*ft,Ti6BU S^n^ 
* **>6©^<*->*«: J:S*y 7aaJB«Mc»-5i» 
■CfKWS ft/dfcttr- tip h®&<DE.-£jfflVi$:mt 

[0 024] irS3Mi®«J!9ft-r Sfc». iftP97iB» 

x * *«c j: o aeaojwfc©/<c * - >36%«#«:aKL 
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iw!5s»*i*iau ^*->*©a^flttKa-3*Hng 

K. C©«Wfcfi1*«R:J:9*rt*iW^*£*l5£Sft 

fci^OA4MtiOt, X>J ? h^'^->f-^tcS 

^<><*-:^£^LT^©»lfr&£iHL c©g 

[002 5 ] U8BS!H©*JB8W-Sfc«!>. KUJdBSBiR 

©iMHtt. it#B5*fctt6K:*a»-c. Misc^tiy 
x * * «: j: o ee*>^i»©><*->**«#fc«f5 o 
rtK*affi±©SM(Cct o *&£ffia&&Bi b . 
c ©tt^w«u> *=>©M©x » yasB*iwi-j- * i S«c . 
/<* ->#©jMeaea>6aa©:t „ s^aa-ccs s * 

fi3&>6i»2^a«©Plfl!JCC*stf4jBHa*«iWO. Cft6 

©»fflffi*ffli»r*#©=^^tt©»ats**aiE-r 

So 

[0 02 6 ] m9B8MQ*:ffi&i>1tlb t QSBtt 
©f£IB«. |^3B8CC4o^-C. tfttllffi±©KM© i ? 

s^aa i *#©'ii«fiaB tao. ei-©* s * *5o« 
««ri{c»tt©¥iii»t**a»tc»sio. #fa3ft/dsi 

[0027] friBRao^jfift-r&^A. ngss i obb 

2© U>Xt Lr«US*«a««:iBE5I8B«t U>X£ffl 

t>siftK, H-©ws*^j{B*c:4{c»asnfc* 

»©««<: i©JHRSta{GBIb. Cft6©««©W» 
ttSSJCffi^T. |tjl2U>X©^*5:CPUtcJ:9-l'> 

^ - 7 x - xfcfl-u r iSST5„ 

[0028] ireBUio&jRft-r^Aitt. n^oi i i ts 

tt©lfiWa. S»*B5~l 0©fiIt»*i3HK:*»i>r. f 
"«T:©7"uy*d»**»6''«j'->*%aKLai>tt!B* 

hr* z - >#*uae ufcttisft *m 5 k j: o atj u/cn 

• i®. &HBRKfctfSlW^*lKHU C©SSS* S 
©1S««c J: SiJJSr- **6«ft©=*7C»«*9WJ-r 
[0 02 9 ] KTSBiRSO&lllft-r iftitt. 90389 1 2 IB 

^*©i/>xiU"c»o*«awKsaR«ift:u>x% 

S/cfcfc u >X©ig? 0 %c P U KJ: 0 ^ > ^ -y x - x 
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[0030] fJlEISM<S>£ftS&-f 4fc». 3f$Q 1 3 IB 

vmf&m.. n>m 5 ~ 1 o ©rati* 1 ek*k,>-c. "5" 
-t-c ©? p v> * * $ *» -yytzmeb tcvimz * 

* v VC J: *) mi LtM* h . »tt©&Sitt8(c JrOSI 

iWTSiftCC, C©«W5W©««K«fc*iW?Ef- 10 
6«Ht©HWc»tt*lt«"J' *. 

[oo3i] Buias^®'&^-r^fcS) > n*gi 1 4te 

a>tc u > x©$ 0 4 c p u (c j; 0 -f > * - 7 1 - x 
ix$m u « 9 *!BS£ o^Ktt-nvsii©iiffiiiraR« 

Sgffltti 0 . tlTH©#RtHMtc <fc ") BWfi^m t $ 
ftfcfiWSK-3l>-C80 ©BKCCJ: <9iS?K<ii«bL/<:^ 20 

iffigL. M@©^«tHWS*illiett«0)ffc^@©H- 

£»c£ Ur«#©=*5EJB«%BHM-r -6. 
[0 032] 

[ffffl] J»#JS 1 ©fMBfcteHT. ttftKJUBS ti*^ 

A £ - > * * 'J ic# #> ft tc ts 7 - t L T :/ a V x. *j 
ffrfcHrtttcSSBSft*. *©IR. *(*KlMWS^f 30 
JWfflRlft#©;ftl>X'J » h 

<fc©*flll>*.- C©B. !JKtt. #5£© 

fe)?£#£S|Jpl? *J:5tt/< * & * ft . 

C©M*->3fc*4M*KJMI?r4£. W*©#ttKlSt; 
fcS3&«HW»#* *7icJ:9tlifJ;*ft*. 

[0033] asijufc^f^iii^^i/fcfe^jr 
i^si-rsi. ««©»«: iHaaBUd^©^*-^* 

ffi'j-r a/cawaiiSt, >jg$ssu£#© a * - > im\i> 

}gtt©«<bw**ii>»^K«. &i*m& 

SKS^©^"$->*flH,»5^>S*i*S. 
[0 0 3 4] C©£9rctt. Cftf>©^*->££>&L 

-csfc^ * - >#£i9:f£T s t ft «c-flt©a«-^ag^tt 
m^?Kti[^©^ , 5'->*^«iff$g©^?i* l *c. » 50 
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W&iEiKC£ttiT*&(,»C *©fc«MC*1\ 
^JSift8Wt#©rt * - 6 -? ? a WajBtt**Hi u 
rfc*. *c>rK«,>a«aRfiJE»©^'«*->*fflo»"cv* 
ott*«tt1«a©^«fi|J»*liiE-rsCi«:j:0. ESt 

[003 5] »*S2ffi«©IB9!T?tt. ^#tctS:i?tS 
^fiJExy 7 h tb-C. «JE©BI-HiBteE»% 
WU> (fttliffl tLUtz/ 2. jc. 3TC/2Toi/ 

*l6©'<*->f e -irtSJ!5cSeijS»tO , C^lS-rS. 
c©^Sftfc^*->**»#tc8»0"Ciei5«HF-B 
#*fi^L. 1 ft©SOgttflii<ll3&»6fe»ll«:J: Oftffi 
ffic:i©«»tt^lB«»c»«W4. cfti=.©iii^ra©§ 

[003 6] ft*53SBlS©l%BJ-c« > «|!(#©*^ 7 

(CJ: 01*JB5riAl*»6iliWr *B8«:«4"r45Eft*tt < 
'■r. -Tftto*. «R#©*^ 5 «:«!:») WW Lfc*ft©» 

air »»«T^ffi«c!»tt©a^w«:steSKtt fen-ij-c * 

[003 7] f»*54fBt8©^B^r«. »ft©¥i0Ktt 
aW*#<-e©SHW«H*«l£t»«^K. WS#©#^5K 
«fcorJ8«BSH*^l|-r*. «J»fi©*>9K:«fc*)«ft 
iHRKWMUtTjettf 1 - £ £l=,fi£f ft«. ^*^/c« 

[0038] «*a5fBii©^B^-c«. tomcat 

ft(c^*->*4»»-r*. *^9*1W*©JU:«:Ea 

U. «^#©7 , n^x^ ; 5i4-eft-eft#4a)±^ci5Bt 
^©IHifigl5»-C{*i9:i?gPffliJ©^KB^^ - 

>*3»afc4*«. -e©jgW{sijr«^ft©meig|5»(cj:o 

IBl/T3i5tt*tKMra c©«©tHB£8?rtt. 

(W1H©*««lcSriCi3&i"C*. ^»©^i*Jf5«?r 

[003 9] M«]I6Rfl©lftQ'Cli v ®W<0¥Mfcft 
*©fHWHB*«l£c»«^K:. IWftfi©^nyx 

^*K«fco^>->*©jft«««*»«-rs. Mfcs© 

7-a^x^^K:d;>)l5B#K:i^u. l^*fc«fflm^© 

^fcj; z>wmT- z& 6*»©=3eaBtt*stirr 

<fc0fifc}f^r-5f4^^ft«. «rt**fctt*-y54 

Sttsea-i:*** < , 1 s©iifluc <t o^($©±(*w 
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[0040] m>m7iz$L<Dm<D{*mzmw-?z>. a 

Ki^±#SJ:5ft»tt*J*o*§£. «K<*tifc>"«*- 
{fi^i0t«c*ttH3ftfti.». <£ -?"C, Uft^ffi 
iE«rcft<ft*. 

[0 04 1 ] C©«fc 5ft*rfttC*tt/t. a^ORPJilHl 

©MBSatt. *f*©80WH»©iS3. ^B}?*?*© 
ftg, ^*->*©a»flK«:{R#u c©&g&tf8: 

©i&^SRtrasfctt* a»©^n^ 
>#©&§£«: J: •) ft 6 JifcWteH 
©IMWM4 * 'J v h - VTB 

tt*l«|-J-4«ll*»5&r*Ci*«T*. *©«««:» 

i/r©*^*#fflTft««tj^©yt»©^*wft 

[0042] ft-m8tm<D&w<Dimz$ftw-tz. m 20 

iit3<J97©&BJ£#Sft*K ^f*©*ffi±K: 011*95 
##2fe£-r£. C©»KgP^?rlf-Si)f ^ftaffl± . 

©ism©* » ytatatms *»af* c £ 4. 
wu ikh s nfcgas©x » s^©iwH©i«fi**ifli u 

■CI«ftJKtt*«3£-J-SC iaWCSr*. 
[0043] M3K3H9 SBtKO»qg-r»« £ffl$fttc&& 
ft8^t*tc»l/O<*->#*JSae0T. gm«4»fiX 30 

Kflt£*>6ftlilU *»©¥lf3l5tt*iai-©»3*»-3 

«K©*wu«HW3. igjft©®i^ 
«3 . 7>j5h^ji->t or mffl-c £ ft < ft 

[0 04 4] fCT, »«3nfc««£:i©IS3K|6C 

a'j<; >^*->©JiMiU!R#*3Mb£-tf4. Sifffi 
±r©jaiSSre?*.tf. »3©ffiir»»aH:tt!fct»;*y ? 40 

(K(r>Haa»is»©x y » . is 

'J» HA*->) ©^»->**ftRr4CfC. 
i^icbfc 0 Pitt©* 'J ? h ¥ - # . |5H£© 

[0045] 1 0BBtt©«iPi©fPffl*tt"H-r4. 

1«J(*Sffi±©IHliIbas©8£#* * < ft £ £ . 
£ ©Si? u > X©8lS £ WH-r 4 * j ^ © u > xam& 
*ce. hasp©* 7 t?o&M&o 

*3ta#©lftSWa«RCfK3i*»6. 50 
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©?iss*j#offl«c:i«:»*ii-r4. *i/c. *sittftM 

U «Ui©l*S«:S-3i»-rcPU«:J:*)u>X©iL#, 
«HfWS. C*Uc«J:»). *Jtt©=&5S&tt£-IBiWi 

[0 046] Ift&g 1 1 SEK©IE9i©ftffi*tt9!-r 5. 
1W*3iiBK»ti^JvS©?L. SMi*>S&S#**S»-r 

a. saKsnyt^f-^^jEsttcaiiisfifti*. en 

e>©SB#£, ffe©IE^Ct»J3ii£a$#£H&fc&oT 

£tt bfctMI*>*ffliS& 4 ©4 ft 
[ 0 0 4 7 } ftoT. ntl^MktB&ttZWkhW&k 

>**fi»-&r«:a8H OfcflRRR«B©Ii**ft 

5. COBHWctt. ^ftHSStt«rftC>|(R0."«Ttt 

mcw%<omw £ ibi«©>< * - Lit&mw. 

[0 048] ^L/T. Cti£©Bifflfll©&HX<C*stt& 
WSHiHa-ri. C©M»Ke£>££, 

*©BBR"t?»/<*->©3t^b*« 
fiJ-T^c ttt-c*fti». c©J: 9fc»»*^8M*ttil/t 
*©»u»"t?©mtt©»att**»i«i/r»tt73e 

h<D?- *©**ffli»T«#©=»7aBtt**wr *. 

[0 04 9] M*^ 1 2!Bi£©#6BJ©ftffl*g&BB-f 

*3nftlf>«Wil/-C«fflS*iytlKH*«. MS^Sice 
HT ^C-C, C©IHIT»«An(cMfll 

^b-C^t. ii|5l©ti-S«J;»3*>Jlsafii (iSSffl) *± 

u . /j\a©?L© j: 5 ft fi^s <t anffft <*•<* - yimm 

■"C*ftl>IR*4 . M££±tf 4 c i«c J: -aT«W*niHfi 
KftS««t K^ltr*. JSK*±tfT«*0fc8B** 

6. i@ar«^5iiftoytfli«©jBtt%»m/. 

*K^TSC JBiE*ft»tt*»4C S. 
[0050] tt^tQ 1 38Btt©»W©ffiffl%SW!TS. 
IH(Bf*r* S«J»©tWW^«©<fc 5 K*iR#* 5tt 

»£HttKC©S«aJ»©JBtt%»mTSi. ^FiEftft 

Uft <»BEii*««fBiurir»sa5») =&^S)^mT4. * 
LT. a«©jf{Bi4H«ffl''«i'->*aKc. ^M^t*; 

S©iS^?:?iS. C©B»*^. «K«**fiiWl/-Cl»S 

»K»w«ai/-ct»*««*»&©iwii*Hiitt-rs c £ 

[0051] fi*5 1 A%m<Dmbo\m*wm?z. 
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^•c«> «MW:ll^tt&«»)*fcoL'>X*?n 

blew*** 6 . 1 El a THSRE i o fc«tt©JBtt*» 
[0 052] 

[»9!©3Sft©«a] OT..HK»-s'r£»91©*tt© 
»2H"C**). C ©H*#MRl/ £#6111*911 K«©I6 

wowtojBM**^*. *r. ioi «s*ffi-c& 

0. *©±KB=^7^©tK»J*t*T?**«H*l 0 2 

a*WTt c©w*i o 2©x±k:iisot©*7 

-*^7 1 0 30KB 3 ft. M»±*«:tt^ar->*CE) 
aKffl^d^xi'jr 1 0 4#RM3ft*. C©7nS?* 
**10 4tt. X7-/ F70 5?***£H*«:#a[RCJf 

3&-3<<rf*->#*«itti o 2«:KB5iitt6-c*a. 

[0053]ittl 0 2KaK-r4^';9 h^£->r 
CPU 1 0 9CCfc9. ;-?*-W-*i;i 0 7CC 
RGB©371/-A», m&i*ti£„ C©5 5— o©7 
U-ABlIi8 t5 hrfllJiKSti. 02 (a) ©£5 
WPJ4l»«2 0 1 i«fc>«2 0 2 5£IBHT?&5«: 
SEA J: 9 a 'J y 02 (a) 

{C*»l>ryB«*«j V$>hv-{y2 0 3©x^©^- 
££H2 (b)(C^T. CO?-f>2 03±T©xll 
©f-$g(x)S, ^2tC«fc«5^-r^. 

[00543 

Wt2] 

gr(x) = 1 2 8 x s i n (x/a • 7c) +12 7 
[0 05 5] CCC. 0£g(x)^2 5 5©«5Btl/. 
X'J » hXjr->©J9!IHta-cje*a. aBl«±C|( 

a:*:, /hs c»tB^{ctta«ett©K«r>jEaK^*->3W¥ 

l£;*ft-2>. 

[0056] ^$-»t'J 1 0 7 ©RGB-© 3 7 U- 

AK-tn^tiasHtt^wacSHS©^ >*fWEr * 

£. cn6©3 7U-A©#^'f>2 0 3«:teWSxM 
&©r-*30 1, 302, 3 0 3tt03©«fc5K& 
S„ CC-Ctt. ^-230 1 tC*tLT. 3 0 2B1/2 
«. 3 0 3ttl/3ft©H«8»JSS»*»o"Cl>*. Cft 

£301. 302, 3 0 3©£ti.7 r --$f2B4©,fc9(C 
ft*. 

[0 05 7]H4K*Jl>-C. RGB-T^r©7U-A© 
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£tt^>-*©ffla*KKtt4j6"cra. ><*-:/#a«sfe 

tUTttfttcRlgSh*. iB(C. 04©£3O4©<}:5 
«:RGB-r^T©7U-iv©7 : -^30 1, 30 2, 3 
0 3#0r*ft«\ ^©£.&C:tet,>T^£->7fr!>*||fet 

7©RGB©3 7U-A#©7 r -*30 1. 30 2, 3 

0 3=&>'^^->r-^iLT. Sl©afJ^ny*^5f 

1 0 4©*75-?£&'-f*.rt/(t&jMU 
4KrtjB3*lfc#«KJ:»). 

0 2©^ffiK*5-©A*->3t4!ai&r So 
[0 05 8] ftftl 0 2KaR3t«fc^f->*»*5 
-#^5 1 0 3CCj;<3}t&3ft. *©HftttA/DgBfe 

©f^y^JUB^-^B^u-A^*'; i oeccteifl 

3ft4. C©IBflWt. ttfcl 0 2©SX5£»tt«:J:ot: 
See*5SWWBI5«hf-IB«ift4. #7-©£j£&^iI 
fctt. J«^i|§IB#tC7 U-A^* 1 06©RGB7U 
- A tCtg ffi 3 ft S/cfe; Sl^t jr->%RGBK*l^ 
*->fof|WSUt:*JtfH!. 7 1/-Ayt'J 1 0 6©R 
GB 7 l>- A{CBJMBl/fcJBjS*C4©SE»«HfliI(fci 

«Efl"s©»«*J||fTS*l4. 
[0059] C © <fc 5 tciMB t fc-* * - > # 3 A $ - > 
r&ftB". RGB*fl§t»4C£?»fc&H»*fcfe#K*i 

wffitr****. 4-ofci±©^*->*^RRi/-caig-rs 

». atBlt^RGBK^Ufcm-r^fiXU. 
^*'J 1 0 7fc*HfrrSC&»:&4. C©B. 

[0 06 0] ■*■&*>■&. CO^jr-^iaMfcLTft^K 

RGB*»6feB«:fflft-r*c4K:tts© 
-c. *©£*£©A*->ra^fcfr4#«T£fc8{>K: 

«, RGB©tt^ttWK»fl&W'C** ! fi«*«**. C© 

<fc5Ct£)&;*ftfc^*->©&lJ*tTo/df£. fe#8t 
Lz/cBi^Bf^i^t OT©^* 1 0 8Kfg*fi3ft 
•S. H 1 K*»(,»t:. 1 1 OBD/A^&gP. 1 1 

[0 0 6 1 ]H5B, fe^SIS ft/c^£->© 5%. IS 
1>JS$M5t©^ > - >tc «fe 6X»»?flMl©— 3© 5 

mffl©SLhOgi5»5 02tt. **2J8W»©^f-> 
n^Ai, *M 7 1 0 3 ft>6©SaMft5 0 3 CC 
*J^SiI±0SP^5 0 2K:MjeTiSIJ^5 0 4r«^-^ 
->3WMRLrc»*3t8&. 2S»3^tLrtSffii]f set 

[006 2 ] ^HT»J#ffii (/-CttfRlttf; 

JR*S^-T». SLh»)«|S»5 0 2©»tt«H6©6 0 

«tt#j|tiH3n'ru*9. isi-©7-f>{c>pfo 
■C. tSl>«a«»«»©''«*->ftK«:J:*SOI5«flB« 



(9) 
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H7tC**W&7 0 l©<fc5ftALt'58!5#5 0 2 

{c*jwatswttftofict>. fii.»jis9te£a©>< 

[ o o 6 3 ] tSoT. aftssaaRiiR^®^^-^* 
rni^n^hxm^mtiy. bib. h7©**©jb« 

B0 2**Htt'*C££l/fc. AttWKtt. fil»J3»ft 

$©^SI§|5#£ffiIET6*>©r&S„ CftJCfcfl. 05 
©SLhD8J»5 0 2 36«*IE3n. 06 . H7K7*Lfc* 

*©«stt6 0 2jwjHH3tis. &*. ffJK=&#ta-r4* 

[0 064] f»^2ie«g©^©*Jfe©^?: 

©■7 >±© xffi^-f- $ g (x)#0 8 iCTjk-tJ: *> fc£ 
BR/-«jr->5*-*ftflFfiWS. 08iCteWS? : -* 1 0 20 
OlfCfctU 1 00 2T?«7C/2 > 1 00 3T?«Jt. 1 

0 0 4T?tt3*/2©ffi*Bift*85. Cti6ttPI-©JB 

ssa»**-r*. eti6©? s -*«:ie5e©&ffl*4*.-c£ 

[0 06 5] J?« £ * 1 0 4 fc«t K> . ±ia£j&** 

1 0 3 «C «fc 0 SSil $ ft R G B ©3BI*tt?IBft & . * 
->ftffJSRLteBI©effiCiK»liO. y*'J108{C 

♦swra. cn6©SBg»^B<WB©aiBR«:te«,»-cia 30 

[0066] 1 1 0 tt. M#I3 Btt©IHIi© 

ft^-^y^SftltttKEabfct*©^**. H9K* 

Tct^tC. tJv-UJv 1 0 3©ffiWJK*5-*^7 1 
20 1, 1 20 1 0 3, 120 

1 , 1 2 0 2 ©Xtttf &KS 1 0 1 ±r-ScTS J: 5 K 
•fZ. CCT?. 2 0 3©5WB»©««1 2 0 4. 

1 2 0 5 ©J£Ktt, **©* 7 -W7103 rttffl* J 40 

-ratter #&<.». 

[0067] fi£->T. 1 2 0 3K/t*->*%jag 
Lt^*^7 103. 1201. 1202 #>e>©tl$JE 
•KCfcDJBtfteSttiU **©*5-#;«5 1 0 3T?tt 
WWC* &t» 1 2 0 4 . 1205 9©(i<gt«9f M©» 5 
-*>5 1 20 1. 1 2 0 2K«fcSH«Jii&C£<fc-?-C*i 

&*.t*ai». ttfc. *5-*y5©6«»3#ewW)« 

[0 0 6 8] 2 0 3 0M&K.%tc^>Xte. 010- 
(a) CC7nfc:i< . 1 0 3. 1 2 0 1, 50 



ftffl¥-9-2 16 2 0 
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fc&aUfcA/DSflftgl 0 5. 1 0 5A. 

-A^'JIOB. 106A £*RW. HHRAA* 

ftyiJffJtcHtTf 010 ( b ) icm? Ct < . A/ 
DSEftSl 0 5R<>*7 U-A^*'; 1 0 6 £01 tm% 

tClimtL. iJv-iJJvlOZ, 120 1. £ 

A/D^jftS 1 0 5 i©IHK»tf fctifcWJftS 13 0 1 

*c p u i o 9 kj: o tqgp iyTB»%*^A*-rn«m 

[ 0 0 6 9 ] 0 1 1 «, »JCT4B«©$6gj©IS*©J& 
«T* 0 . ftiB*f*£ ft ilft 1 4 0 3 (WWHW* 
St>»£©ttai8B©fllJ^*0TI,>S. SEK 

ffiofefeK. l®gr&©»-7-*^-7 1 0 3. 1 40 1, 
1 4 0 2 ©WS-C1M* 1 4 0 3 ©±?&K3HftU 

-ay 7©^f!tt 3 #ew©*»fit?*n«ai». tun' 

1 40 3©W3WffiiBttKl£DTifcjET5. 

03. 1 40 1, 1 402#>6©A#*«. 01 OdCfjk 

3 . 1401. 140 2 k jzzmmmcmiz 
1 4 o 3©«a**«K*iw*j^*#abr*©is* 

*£JSU «*^»©=^5c»ttftlHMrS. 

[ o o 7 o ] 0 1 2 «i«*^5 tamo9tm<D9»<mn 

VA*), 5 0 2*««te©^ , O^*f *K«t«3* 

***ifti*>6jaiBr*»^©fc©r**. Hi2tc*5i» 

T> *7-W7l03l:MniO7 , ay I i'j!l 

0 4£*2©:7ai>*** 15 0 1 i^r^f* 1 5 02K 
»LJWBttKEIW4. *7-^7l03, 

1 04, 1 50 l©jKM»SW61 0 l±rHRL 

cct?. ^oy*^*tt2#je,{Ji-©fl8»6'ct» 

[0 07 1 ] f KD^ayx^f 1 0 4CCJ:0SU^3tl 
*A*->*t?tt. ®& 1 5 0 2©fiRifl 1 5 0 3 

1 5 0 2&MtU:*)mmZft-Cb£'j<DV. /"?jr->36 

1 5 0 3 ©affiKSKS tlttl>. C©J:5 
1 5 0 3(COt,5-ctt. ^2©7*a^j:^^ 1 50 1*6 
^•£->3fc£Mjl/T;*77-2M5 1 0 3{C<tOHfJT 

[0 0 7 2 ] 1 0 4. 150 lfrh<D®B 

icmc^Xit. 013 (a) ©«t J JKJB2©^ , Ciy*4' 
^15 0 lfflKJteU/cv^-V^^U 16 0 1 

^ut. »2©^ , cr^xd' > 1 5 o imicm \<D7 

WxtZl 0 4 i»iStt*6ld^*t*0' , « 

)SbT^"$->^* V 16 0 1 KfeiWL. v-?£->y* 

•J 1 0 7. 1 6 0 1 ©A$->r-^5:II,»t7 - Pi/i 

2* 1 04. 1 50 lK<fc0H««:aBU. 

7 1 0 3KJ:»)l8B«ffili»%«ilU'CejS»*ftlt-r 

4. 

[0 07 3] *fctt. 013 (b) W^^D^* 
i? 1 04. 1 5 0 1 <b#— ©^•$->^*'J 1 0 7<t© 
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MtCttft&l 6 0 2-*RW. 7P5>x 1 0 4 KJ: i> 
•rt$-y%tV''ai/x>7$ 1 5 0 lCC<fc&^£->:)fc<t 

A^SfcJijK^LWJSftteaBft^ettft 1 5 0 2©& 
SMJJBttfcJWHU *©StesW4C£"C. &&£&© 

[ 0 0 7 4 ] 0 1 4 BM^61Bt!i©J^©Jgib©fl*JB 
■C* 0 . tKW»*t?*S«ll* 17 0 1 ©¥iEJBtf»*** 

t»»^®fc©tr*s. c©iat©JB»"Ctt. W17 0 

lfCftt,ftg<*ft/cJfU©7"ni/x**l 7 0 2RO*® 
2®7a&*9* l 7 0 3tcj:»). 7 0 l tcMT 

«v<* ft*. ^ay*j*ofi» 

tt 2 #Jil*f©«&#-e 

i o o 7 5 ] mmmt. s^tft^^wno 

4*»IHWaJ:5K:. *t*£&*«*l 7 0 1©*S*» 

Hi 3©J:5K0BJfi^fca;K^?fcjair>. 
§^1^^ 1 702, 1 7 0 3#>6&U3ftfc-'*£ 
->36**5-*M7 1 0 3CC<tOSSiJl/. f#6n/ciffl 
<H*6W(t 1 7.0 1 ©&ffl*r©JBtt%*ai»T-t©J£ 

to 07 6] c©nfc©j$&«:*jc»-c> H9-?>ai i© 

tt. «M*1 7 0 l*fc"B*y?4«t3*4Ci4< 1 
@©»»T«ftl 7 0 l©^#»tt*BHH-r*C4*nO 

[0 0771015 080^97 eEtK©^B©Htfe©^fll 
?6^l/"Cl»S. C©HJ6©JK»tt. H»V&tiMtfiS!Bm 
■*l5!ft<r{C»fr'5fe©t?tttt< . *JMS*6S«MCS[ 
fti^Si^ttJBtttJfoJB^-pftot:**. CftfclEflg 

(cn-sj-n,fcfe©4>©-cs>2)„ 0 1 5(c*ji>t. gig® 
i o i ±<D<m 1801 ©jBttssKw-rsatetc. m 1 

<D-7Ui?x9# 1 0 4*6©J8»Aar-.>jt*RGB"r 

jwifcKttftA^tcu-cuiKrii. smai o 1 

18 0 1 &©gttt«:j: 1 8 0 2*i8£TS. 
C©Mflg»fl' 1 8 0 2 B. mW 1 8 0 1 ©tt9M&H©A 
§ 1 80 3 i^os;xj>*10 4©fil[Bao f ' , «*->* 
©UMBftftKttlW*. 

[0 07 8] C®K»t*5-*^9 1 0 3(C<fc9gI«iJ 

u HfcgKQ&tr. -e^r. KJarc*4**3R©E« 
<7n^***l 0 4©fldKtf»Rfta) m» 
18 0 1 ©ftfPffiBEUmS 1 8 0 3 £gffiT S. £ 
fc. *7-*>7 1 0 3^U^l©7'i3ysi' jf 1 
0 4 ©J£*HH(Cft2 O^oy* j> f 1 8 0 4 £&gf ft 
tf. ttft 1 8 0 1 (DEStMOMIIfitMRVKZ 18 0 5 
##ffl3ft£. IBNtcc. tMft&©^aP*j»d»tKH-r 
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[0 07 9] *{C. h^^-^^-^^BXbT 
«*-*. BWfc^HfcfcttU KttiUfcftttl 8 0 1 

©«wwfi[ii*»6«ft 1801 ©ffart-a«wcoi,»T© 

6 (a) {Cw-r<fc9(c1W*Slii"tr©fflSsfWtt§titt*© 
■e, to^-^tcttu *{c«fflLfc»WWftK©i«3-e 

£>501 6(b) ©■?*-* ?:Jjpi!*-r6CiK:J;9. 01 
10 6 (c) fc^-rafcWWBtt^-*****. CtiKJ: 
•3 , SWHfr &2MIMCfi5 Jt#»* «fc 5 WBttSfc^ft* 
18 0 1 K-3i>Ti. =#^tt*iEIWcfcaiTac£ 

[ 0 0 8 0 ] 0 1 7 Bit*3S8 iBtS©^©^SS©^)i 

*^Lri,»s. c©HJfc©j$5Stt. JtiSK:&M£3rr& 

*ft©»tt*jE«{ClWr4A:ab©t>©T*S. 017 

©<fc5{C, $3ft200 l©afflK®M2 0 0 2*5|?ST 

**B£. tBic^oy*** 1 0 43&»6ir«©c:<b<e 

efr-afcttO^f-^ftfcfiSB-rst. ±IBK£2 0 0 
20 2tCj:»)llltKai»2 0 0 3*J|fi*fer4. C©tt»4*5 
1 0 3K4:9aMl/t:HHR**9i&tf£. K*0 
r*S3t*3fi©Ba*>6a^2 0 02©i? yffiBRtf 
1SS2 0 0 4*»HJ-r5Ci3&Jt?#S. 
[0 08 1 ] ^95^2 0 0 3 Si. ^n^x 1 0 4 
fi>6©&fgtcj: K»fflJfcSW6>hfc»2 
©7'P^x^^2 0 0 5a>e>6fe#^»6©^£--->7fc 

Bfs!58B#2 0 0 3 tt««l3ft&< &3. 
C©C f$£2 0 0 2©2EffliJ#i^< . fcffllJjWSl* 

nzft'jt. si2oo2oj? y{ag©sffljtcfew?, 
»f*sffi©iws*iftffl-r* c i #t # 5o 

[0082]^, 7 - O-/ii'ifl 04, 2 00 5*>6 

UO. *^-*j»9 10 3{CJ:»3IIW"J"5. ^7 10 
3fC»«3i&^m«*>'&»tt%IHIlU. ftHJLfc«*2 
0 0 1 ©^iJg|J^2 0 0 3 K-9l>tB, ^(C^mb/ctf 
$RtCj; 0 &iJg|5#2 0 0 3 ©HWArajtBr* 4*l4J©^" 
o i> x d> f 1 0 4 tc J: SiS:^^ - >*> 6^tt5r»ttl 
40 L, *©«ittS*KJ:0±*»tt**lliEO"C*»©^ 

[ 0 0 8 3 ] 0 1 8 BIMtfl 9 IBtt©^©9ail©^tt 

*7nu-c(,»*. c©**©»»tt. ^fflfcmci^©©M 
%*r**(*©JI^*iEW«:lHII'f*fc«)©fe©tr* 
5. 01 8©«fc5K«ffi«:8ai*8o«tf*2 1 0 1K» 

ur. sis. mitiBimcm#2 1 0 2©tsn5ia 
ft^cttfstcs-^t. B-©*s*»o«w(iac;it»y 

(Ctot, HI 9KwT«fc9<C«#2 1 0 2©TBB»tt 
50 «WK©fiR4l2 2 0 1 , 2 20 2. 2 2 0 3 tC#®lT 
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*. 

[0 08 4] CCt. 2 
10 2JC&&-TS4. H2 0«:^1-J:^{CiW«2 20 2 

£?©-**->£? *»2 3 0 1 tun, 4RJ82 2 0 1 

J:t?C!V<*->tr»^tt2 3 0 2 4ft*. C©J9ttft# 
««2 2 0 2Kio-CjWJT**»^. C<0«*2 2 0 
2 J:0 <>ffil>flM2 .2 0 i - > £ y ft 
*. cfcoT, «*2 2 0 1lTC»«l»«»bUri>**i^ 

ft< ft*. 

[0 08 5] ^©<fc*>ftt§£K:tt. ««c:4flM«^W«C 

[0086] #tc. fl}$£ 1 0 IBiS©^Bj©|85S©Jf5«l 
fcttWfS. W*SM«cfcttSiMS2«>S»ffi4©*fc 

aaWfcfc-rsi. »ft©*3K:«t-3t:«§Bi/>x«io 

T. SI 8tCwl,fcJ:5&aa«*-?»{*2 10 1K» 
US19il^tt«CflM»«*ff5. »«3tlA:*«WK 
MOT, *©«*©! ? y©¥J&JKS*IMHU CPU 
10 9KJ:9fl[j£©Sna«fcSrfart>. £fctt. i&3 

1 0 8CCfift?t,T*5<. 

[ 0 0 8 7 ] g 2 1 iCfe^T, ±j£©<fc 5 (C&S Ltcffl 

sa«> Mus**wr*yt»©-/ x-^ 240 

5(C*B£U 1 0 3Rt>Vo^xi/^f 1 0 4, 2 

40 1©U>X2402, 2403, 2 4 0 4©HtU58i 

Bia©iB*&*il^or«u&&s8r4. *fc. 
tisffigccio, «LS*»BorjBtt**a-ra«w© 

[OO88]019©<t5 (C»K©¥lIBBttrfl*S ft 

fciW2 20 1, 2 20 2, 2 20 3-e&*4*. C 

LTWeSftTHSfcjSr 1 B©JtfttC J: o wtt&tt* 
nati. c©tt«J:»)feH«c«fllKft»fci>»^K: 
tt. AM 2 2 0 2 £ 2 2 0 3 il*Jtl««JiSl>KS"C*4 
Ci*»6B-*WU:0T»<»>. lBOflUSWEi 20© 

$2201-220 3-r^"C**3*«»ttifflB!l©«i* 
&OT8H,>. 2 0©iSMaW£30©'<*->IMB£K 
J:9«tf«Btt*«H-r*. Cft6©jfoaiWRtM*- 

>iuH©Btti2. Bvmfflumtc5z.e>txz>mmtm 
[0089] fguoi 1 1 teis©^Bj©njt©^si 

02 2 (a) fcfi*T J:5K. !M*glE©l 



1) WHMP9-2 1620 

20 

*©54>2.5 0 1 ±K:f5ft2 5 0 2Rtf/hft©?L2 5 
0 3 *«££:£ *.*. C©*BIHCAar->jfe%a|g 
"Tlx!:, «ti2 5 0 22^^712 5 0 3K»lS-r5«lSII 
tt. **ve*lH2 2 (b) «C*ftt4W*2.5 0 4. 2 5 
0 5©«fc$K&4. 

[0 09 0 ] C©J:9tt-"car->j6»6}Btt*IWH-r5 
4. fifJfS2 5 0 4, 2 50 5©»»"C}Btt*i*E&«C 
0. *©**««** &£{*©«WI*K»6h& 

ttr>r. sr. £©:7py***a»&fc/<*-># 
io *s»utti>iiajiKtt«r«aB-r4. c©4*©5-f> 

2 5 0 1 ©JUKffili. 02 3 ( a ) CCfctf* 2 6 0 1 4 
ft9. efe*»-3<Rifi©A3f->3t%S7"ayx^5f*i6 
t^U/ci§£©aiK{Sl*2 60 24ft*. C©4*. ft 
ft 2 5 0 2 ROTL2 5 0 3 K*tf&TS«l*2 6 0 3,2 
6 0 4TB, SSK<82 6 0 2 4 2 6 0 1 4©g#4>ft < 
ft*. 

[0 09 n-Tfctofc. «82 6 0 3. 2 6 04T(i, 
$ftl,»CiK:fc*. M$2 6 0 3, 2 60 4«4* 

20 ©^rioi*>6.©aKt?*>«*-rsc49*>6. ctihom 

$2 6 0 3, 2 6 0 4«KH(C«fc*fe©-Ctt&l,>C4# 
to*>*„ 

[0 09 2] X'J? h/^-^-^ftg-K 
**ffl!Jlyfc*£©S:fiffltt. 02 3 (b)©2 60 5 
4ft*. »gffi£JM$£&M$r8?#T-r*»£. $$2 6 
0 9. 2 6 1 0 (02 3 (a) ©M$2 6 0 3. 26 0 
4) «y^X^Wft7 r -^4ft*/c*. Jl@ffl2 6 0 
5©r-£*>f>$I$2 6 0 9. 26 lO©^-*^]^ 
•rS. fi£oT. #EBri*ft/<:02 3 (b)©fttt2 6 0 
30 6, 26 0 7. 26 0 81*3?. ffl* KJBttiJWTS. 

[0093] *»wft«tt©=3gc3P«*9aer sb. 

£>*ft6fcf. M$2 6 0 6, 2 6 07, 2 6 08%-e© 
**8»6U W&2 6 0 9. 26 1 0 ©»»«&«*£ 
£0fc**r*8«*£T*. &i&*S3i4L-C±a©J: 

<®$2 609,2610) \,mmc-cmm?zm<Dffi 
[0094] mmmuBttz&mtzi&mimi. 

40 ft**0Sa^ftl>Ji^(C«. B5a$L/c^n2 5 0 2-^?L2 
5 0 3©l@<fc0 fc+»«C*«,»««jftf#-3^ jr->**R 
KU. H2 4K*5»42 7 0 1 ~2 7 0 4©fi[S?:?i* 
C£rffl»Btt«W2 6 0 6. 2 60 7, 2 60 8*^6 
IWa3ti*:J|gtt*«ttL. «ft©±i*«tt*8B£f SC 
4^>pf^-C** 0 ftfe. C©H*S©^«. «5*affi(C 

*. 

[0095] &t,»"C. f@J}?^ 1 2ffitt©AQ©Xtk©» 
»*BWr*. C©HJfi©^T«. S2 2(C7nO/cJ; 
50 5fc«t®Bi©fttt*/hSl.>?L m«ft4*(Cj;0^*i 



02) 

a 

<H£tiJjn$-t*£. fftb-fc, 02 ijc^l/c-o*-? 

x.-Z2 4 0 5lC£*)UyX2 4 0 2~2 4 0 4©$*) 
[0096] CCT. i'©7"Di;ii'W6^i'-> 

it, -en^n02 5©2 8 o 1, 2 8O24&S.02 

5©{I^2 8 04 (02 2©?L2 5 0 3(c<fc302 3© 10 
M$2 6 0 4, 2 6 1 OJCttlfc) -Ctt> i@S£if ftlUT 
&2801, 2802 ©«fSM«^/jNr* •) . 
**lSaB0TfetHlltt^ftr*4. $1^2 80 3 

(132 2©S*i2 5 0 2 CCfc^a 2 3 ©MHS2 6 0 3 . 
2 6 0 9 tC*tjCS) ?»2 8 0 1, 2 8 0 2©MK&tfJt 

flnu c©w?A*->**iMeThtfW*a^tt4 

Stores. 

[0 0 97] 02 6 tt. h^£->r-^K:K~3 

<^^->^tauL/cit©»efii^uTt,^ 0 i 

B a -CWitl'J Wc r» fcH 2 2 ©t^ft 2 5 0 2 ©gPfl-T? 20 
fc> H2 8©fftt2 9 0 1 iC*jUT^'^->*W§ 

t -eoff^^jESSfcmj-r * c 4 » * . 

[ o o 9 8 1 *tc. msm i 3 m®<D¥im®9m<Dxm 

**r«*6«to. «E?©i^<*->#©K»>wittr» 

r. affl-c©sit*i^i,^f4j!pe.)ss©n$3 o o 1 tc;s 

>->**«l^r*i. IWM©3E{fcttH2 7 (b) © 30 

3003©J:5CCft£. 

[0 0 9 9] C©B#. ?as;x?jri 0 4(CjEttt/tC> 
Sffll4BB3 0 0 2-CSiJ$nii5fSfii«. 02 7 (b) 
©^3 0 0 6 CU5tt& 3 0 0 4 4& *) . BJfgriSfl] 

ufctfc^a^-rs©-??-'^- > i uT©^b*s©e.n 

[OlOOl^CT. afe-C*Sift©^d'->jt*^'ny 
*.*dri 0 4*6aK-r4t. *©WKI§ttlB2 8©3 
1 0 1 4&S. C©/c«>. S*8fg<il3 1 0 2 4©M# 40 
®$3 00543007 ©*«COt>-C-»<*->3fe 

%s«BO"c«»©=^c«tt**a-r*. c©»*. g& 

M3 0 0 2 K»(t?T 4«W 3 0 0 6 «C-X>Ttt*©* £ 

^F3i©«*4 0T«airs. 

[0101] &l>?. gt$g 1 4lBiS©^^©HJfe©ffJ 
JB*SWH-rS. COHflWWBISrtt. B2 8(cbtt&JB 
tt^F9EtfflES*ifc«*3 0 0 6 ICttLXm&ZW&Z 
ttS. 02 lK*5Wi^>^-7x-X2 4 0 5{c<fc 
0. ls>:72 4 0 2^-2 4 0 4©&9£M1SU SKf 
S**->Jfc4**5 10 3^flW6**jfel>S-l*S. C 50 



«f§1¥9 - 2 1 6 2 0 
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ct, tt$3 o o i (cwiyraerjili*©^*-^** 
^cu/x^freanj-rat. *©wattttH2 9©3 

2 0 1 4&3. ffl@JB«PRiifl)edtiA:8l«3 0 0 6 
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